-- Logs begin at Tue 2022-08-23 21:25:32 UTC, end at Tue 2022-08-23 22:44:29 UTC. -- Aug 23 22:15:06.640643 dv-cinder-850321-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 22:15:06.655221 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 22:15:06.658175 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 22:15:06 2022] *** Aug 23 22:15:06.658175 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 22:15:06.658175 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 22:15:06.658175 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: nodename: dv-cinder-850321-4-iscsi Aug 23 22:15:06.658175 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: machine: x86_64 Aug 23 22:15:06.658175 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: clock source: unix Aug 23 22:15:06.658175 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: pcre jit disabled Aug 23 22:15:06.658175 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: detected number of CPU cores: 4 Aug 23 22:15:06.658175 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: current working directory: / Aug 23 22:15:06.659262 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: detected binary path: /usr/bin/uwsgi-core Aug 23 22:15:06.659262 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: your processes number limit is 47680 Aug 23 22:15:06.659262 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: your memory page size is 4096 bytes Aug 23 22:15:06.659262 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: detected max file descriptor number: 2048 Aug 23 22:15:06.659262 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: lock engine: pthread robust mutexes Aug 23 22:15:06.659262 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: thunder lock: enabled Aug 23 22:15:06.659262 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 22:15:06.659262 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 22:15:06.714862 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: Python main interpreter initialized at 0x55e9c91fc9c0 Aug 23 22:15:06.714862 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: python threads support enabled Aug 23 22:15:06.714862 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: your server socket listen backlog is limited to 100 connections Aug 23 22:15:06.714862 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: your mercy for graceful operations on workers is 90 seconds Aug 23 22:15:06.715363 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 22:15:06.715363 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: *** Operational MODE: preforking *** Aug 23 22:15:06.715570 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: *** uWSGI is running in multiple interpreter mode *** Aug 23 22:15:06.715570 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: spawned uWSGI master process (pid: 105808) Aug 23 22:15:06.715832 dv-cinder-850321-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 22:15:06.717014 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: spawned uWSGI worker 1 (pid: 105809, cores: 1) Aug 23 22:15:06.717014 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: spawned uWSGI worker 2 (pid: 105810, cores: 1) Aug 23 22:15:06.717014 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 22:15:07.437638 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 22:15:07.979623 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 22:15:08.604717 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:15:08.604717 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: from cryptography.utils import int_from_bytes Aug 23 22:15:08.605393 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:15:08.605393 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: from cryptography.utils import int_from_bytes Aug 23 22:15:09.078981 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:15:09.078981 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: from cryptography.utils import int_from_bytes Aug 23 22:15:09.079913 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:15:09.079913 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: from cryptography.utils import int_from_bytes Aug 23 22:15:11.211081 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:15:11.211758 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:15:11.211934 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:15:11.212425 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:15:11.212669 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:15:11.212950 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.213250 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.213581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.213907 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.214241 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.214552 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.214877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.215200 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.215531 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.215792 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.216116 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.216439 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-4-iscsi {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.216765 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.217099 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.217419 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.217763 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.218050 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.218375 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.218683 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.219189 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.219645 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.219956 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.220273 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.220611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.220932 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.221271 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.221603 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.221916 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.222304 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.223203 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.223921 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-4-iscsi {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.224280 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.224603 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.224931 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.225388 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.225711 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.226029 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.226349 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.226680 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.226997 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.227381 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.227654 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.227979 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.228306 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.228645 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.228928 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.229316 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.229593 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.229903 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.230211 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.230467 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.230842 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.231102 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.231425 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.231816 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.232000 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.232252 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.232574 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.232899 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.233246 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.233559 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.233874 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.234178 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.234852 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.234852 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.235150 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.235391 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.235708 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.236029 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.236355 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.236663 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.236986 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.237524 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.237808 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.238293 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.238930 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.239500 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.239823 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.240151 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.240583 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.240905 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.241376 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.241768 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.242160 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.242605 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.242923 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.243216 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.243635 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.243951 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.244385 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.244782 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.245202 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.245607 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.245994 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.246521 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.246848 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.247160 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.247474 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.247792 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.248114 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.248409 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.248724 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.249032 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.249715 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.249715 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.250161 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.250455 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.250721 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.250953 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.251279 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.251596 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.251911 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.252233 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.252547 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.252858 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.253210 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.253601 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.254080 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.254678 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.255212 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.255332 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.255633 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.255951 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.256267 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.256575 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.256886 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.257233 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.257544 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.257852 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.258160 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.258463 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.258789 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.259115 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.259430 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.259746 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.260053 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.260373 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.260716 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.261087 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.261426 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.261743 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.262080 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.262414 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.262741 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.263063 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.263381 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.263708 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.264027 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.264344 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.264677 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.264984 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.265406 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.265798 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.266126 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.266451 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.266774 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.267093 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.267415 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.267751 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.268083 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.268399 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.268745 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.269701 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.270174 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.270770 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.271121 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.271450 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.271770 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.272171 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.272423 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.272762 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.273147 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.273471 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.274004 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.274109 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.274412 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.274734 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.275046 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.275389 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.275830 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.276031 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.276412 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.276666 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.276981 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.277505 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.277667 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.277950 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.278340 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.278568 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.278881 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.279189 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.279513 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.279850 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.280164 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.280500 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.280809 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.281153 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.281478 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.281793 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.282102 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.282418 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.282733 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.283041 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.283371 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.283691 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.284002 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.284321 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.284628 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.285512 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.286087 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.286538 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.286858 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.287181 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.287499 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.287833 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.288156 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.288469 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.288809 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.289177 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.289487 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.289816 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.290195 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.290465 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.290773 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.291094 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.291405 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.291717 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.292016 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.292329 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.292644 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.293189 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.293511 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.293868 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.294227 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.294512 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.294822 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.295133 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.295441 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.295758 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.296102 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.296413 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.296762 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.297359 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.297735 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.298065 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.298386 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.298712 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.299032 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.299355 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.299675 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.299991 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.300344 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.300749 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.301345 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.301730 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.302073 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.302393 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.302713 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.303023 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.303345 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.303693 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.304033 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.304356 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.304683 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.304999 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.305349 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.305921 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.306239 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.306558 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.306871 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.307197 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.307689 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.308131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.308451 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.308785 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.309135 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.309465 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.309962 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.310324 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.310666 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.311005 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.311505 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.311848 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.312265 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.312672 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.312991 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.313340 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.313659 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.313976 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.314291 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.314615 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.314933 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.315248 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.315573 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.315929 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.316461 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.317168 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.317398 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.317723 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.318064 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.318373 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.318704 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.319029 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.319339 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.319653 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.319977 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.320291 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.320603 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.320913 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.321255 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.321611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.321931 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.322240 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.322561 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.322889 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.323202 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.323521 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.323834 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.324149 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.324473 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.324790 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.325126 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.325444 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.325757 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.326070 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.326382 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.326707 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.327021 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.327333 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.327645 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.327954 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.328268 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.328587 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.329270 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.329611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.329934 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.330255 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.330581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.330904 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.331234 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.332087 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.332569 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.333115 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.333443 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.333758 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.334071 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.334388 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.334703 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.335018 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.335323 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.335638 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.335947 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.336259 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.336569 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.336871 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.337215 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.337528 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.337844 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.338142 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.338475 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.338781 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.339097 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.339395 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.339703 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.340059 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.340369 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.340816 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.341031 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.341402 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.341714 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.342021 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.342355 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.342663 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.342969 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.343273 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.343587 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.343899 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.344204 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.344518 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.344831 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.345172 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.345486 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.345795 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.346108 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.346415 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.346734 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.347045 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.348050 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.348539 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.349047 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.349390 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.349704 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.350023 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.350336 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.350660 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.350972 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.351278 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.351588 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.351903 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.352219 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.352533 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.352869 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.353219 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.353533 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.353843 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.354160 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.354474 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.354782 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.355099 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.355428 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.355749 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.356056 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.356371 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.356682 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.356990 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.357334 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.357644 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.357953 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.358261 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.358568 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.358874 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.359181 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.359505 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.359820 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.360128 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.360435 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.360741 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.361121 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.361429 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.361793 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.362104 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.362428 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.362790 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.363150 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.363739 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.364110 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.364422 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.364746 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.365097 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.365407 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.365718 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.366028 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.366357 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.366673 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.366988 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.367313 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.367641 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.367967 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.368275 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.368591 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.368906 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.369256 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.369567 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.369880 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.370195 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.370511 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.370827 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.371153 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.371461 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.371774 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.372136 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.372406 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.372714 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.373046 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.373725 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.373725 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.374000 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.374306 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.374620 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.374929 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.375372 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.375685 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.376000 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.376306 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.376619 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.376933 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.377538 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.377538 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.377935 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.378303 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.378655 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.379144 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.379719 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.380039 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.380353 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.380673 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.381005 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.381345 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.381652 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.381961 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.382291 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.382601 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.382925 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.383349 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.383670 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.383976 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.384396 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.384715 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.385031 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.385383 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.385711 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.386036 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.386345 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.386664 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.386978 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.387306 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.387632 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.387948 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.388265 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.388572 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.388900 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.389252 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.389568 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.389894 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.390313 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.390637 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.390954 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.391279 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.391608 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.391915 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.392225 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.392540 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.392848 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.393184 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.393512 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.393825 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.394752 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.395226 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.395793 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.396120 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.396435 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.396767 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.397099 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.397438 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.397758 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.398087 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.398417 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.398732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.399055 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.399371 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.399681 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.399988 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.400296 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.400643 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.400952 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.401306 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.401640 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.401971 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.402284 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.402623 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.403476 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.403476 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.403667 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.403909 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.404215 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.404521 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.404837 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.405172 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.405482 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.405790 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.406102 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.406408 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.406874 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.407021 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.407344 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.407651 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.407975 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.408286 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.408595 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.408906 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.409234 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.409583 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.410551 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.411110 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.411470 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.411803 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.412129 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.412451 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.412779 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.413125 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.413452 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.413770 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.414090 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.414406 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.414725 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.415044 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.415846 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.415975 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.416262 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.416581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.416900 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.417255 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.417576 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.417893 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.418210 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.418530 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.418847 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.419163 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.419517 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.419823 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.420153 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.420491 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.421102 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.421224 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.421476 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.421793 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.422152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.422471 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.422786 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.423103 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.423424 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.423741 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.424056 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.424368 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.424683 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.424997 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.425367 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.425888 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.426313 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.426637 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.426967 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.427306 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.427630 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.427952 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.428266 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.428587 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.429158 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.429481 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.429822 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.430152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.430480 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.431058 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.431379 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.431710 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.432019 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.432327 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.432648 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.432960 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.433295 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.433621 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.433936 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.434253 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.434569 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.434882 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.435428 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.435779 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.436097 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.436424 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.436751 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.437086 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.437399 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.437770 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.438082 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.438338 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.438885 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.439405 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.439808 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.440226 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.440758 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.441417 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.442009 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.442644 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.443198 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.443776 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.444366 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.444813 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.445394 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.445777 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.446164 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.446485 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.446850 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.447178 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.447505 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.447819 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.448138 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.448451 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.448770 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.449101 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.449424 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.449743 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.450078 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.450501 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.450751 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.451077 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.451397 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.451736 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.452040 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.452351 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.452698 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.453173 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.453654 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.453974 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.454301 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.454645 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.454981 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.455290 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.455600 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.455908 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.456239 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.457144 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.457517 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.458076 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.458423 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.458743 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.459063 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.459384 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.459703 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.460022 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.460336 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.460651 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.460963 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.461353 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.461623 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.461956 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.462294 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.462620 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.462941 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.463270 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.463589 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.463922 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.464222 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.464535 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.464848 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.465192 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.465527 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.465845 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.466152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.466586 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.466904 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.467231 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.467556 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.467871 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.468224 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.468584 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.468904 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.469255 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.469572 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.469904 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.470249 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.470581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.470910 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.471218 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.471525 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.471831 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.472147 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.473157 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.473754 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.474188 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.474502 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.474822 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.475185 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.475591 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.475936 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.476257 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.476574 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.476912 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.477436 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.477942 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.478351 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.478733 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.479228 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.479716 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.480093 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.480575 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.481083 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.481429 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.481772 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.482134 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.482570 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.482899 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.483259 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.483669 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.484000 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.484344 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.484680 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.485009 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.485362 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.485694 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.486031 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.486350 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.486705 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.486986 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.487302 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.487619 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.488081 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.488627 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.489246 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.489802 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.490407 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.491014 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.491628 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.492238 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.492847 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.493526 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.494108 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.494605 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.494940 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.495271 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.495601 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.495936 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.496261 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.496584 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.496912 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.497276 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.497620 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.497958 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.498279 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.498614 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.498947 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.499311 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.499636 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.500028 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.500329 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.500655 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.500973 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.501205 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:15:11.501712 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.501857 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:15:11.501982 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:15:11.502119 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:15:11.502353 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:15:11.502613 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:15:11.503010 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.503381 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.504357 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.504619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.504914 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.505260 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.505670 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.506001 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.506336 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.506603 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.506922 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.507249 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-4-iscsi {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.507575 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.507882 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.508228 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.508524 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.508856 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.509362 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.509606 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.510218 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.510435 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.510737 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.511051 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.511397 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.511714 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.512032 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.512377 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.512673 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.513004 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.513346 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.513758 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-4-iscsi {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.514081 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.514406 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.514725 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.515154 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.515474 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.515781 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.516105 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.516444 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.516761 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.517113 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.517439 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.517761 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.518083 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.518391 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.518703 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.519015 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.519893 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.520202 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.520510 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.520877 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.521296 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.521626 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.521953 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.522286 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.522542 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.522794 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.523115 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.523438 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.523749 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.524060 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.524366 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.524674 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.524982 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.525316 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.525625 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.525933 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.526254 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.526572 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.526896 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.527203 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.527521 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.527932 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.528185 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.528495 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.528839 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.529181 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.529494 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.529813 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.530134 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.530443 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.530753 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.531060 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.531381 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.531714 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.532027 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.532280 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.532583 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.532891 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.533232 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.533542 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.533849 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.534155 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.534455 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.534882 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.535377 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.535712 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.536024 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.536336 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.536645 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.536954 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.537293 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.537604 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.537932 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.538255 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.538566 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.538879 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.539189 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.539500 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.539824 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.540135 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.540443 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.540768 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.541098 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.541418 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.541738 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.542055 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.542365 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.542872 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.543036 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.543286 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.543608 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.544013 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.544231 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.544539 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.544861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.545192 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.545504 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.545815 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.546124 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.546427 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.546756 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.547082 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.547396 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.547706 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.548018 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.548342 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:15:11.548684 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.549021 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.549395 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.549715 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.550050 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.550649 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.550882 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.551111 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.551434 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.552141 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.552469 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.552793 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.553156 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.553491 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.553814 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.554167 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.554476 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.554798 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.555122 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.555440 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.556018 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.556354 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.556917 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.557119 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.557441 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.557934 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.558281 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.558790 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.559038 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.559393 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.559779 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.560152 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.560546 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.560965 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.561341 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.561741 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.562122 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.562475 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.562801 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.563120 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.563439 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.563801 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.564126 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.564452 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.564770 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.565121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.565444 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.565767 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.566701 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.567009 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.567322 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.567638 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.567953 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.568262 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.568609 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.568933 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.569271 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.569615 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.569931 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.570248 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.570567 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.570884 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.571195 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.571517 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.571839 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.572150 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.572485 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.572802 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.573139 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.573469 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.573787 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.574093 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.574413 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.574729 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.575046 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.575360 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.575714 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.576018 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.576333 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.576651 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.576998 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.577367 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.577677 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.578005 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.578344 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.578662 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.578965 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.579275 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.579588 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.579893 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.580199 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.580512 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.580821 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.581161 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.581470 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.582395 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.582790 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.583129 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.583444 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.583755 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.584067 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.584374 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.584731 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.585040 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.585421 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.585767 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.586095 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.586423 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.586742 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.587068 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.587382 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.587701 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.588019 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.588334 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.588657 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.588973 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.589323 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.589641 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.589978 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.590292 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.590616 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.590925 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.591246 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.591593 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.591948 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.592265 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.592589 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.592902 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.593253 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.593572 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.593885 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.594201 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.594518 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.594843 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.595164 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.595484 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.595798 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.596141 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.596458 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.596779 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.597136 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.598003 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.598345 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.598687 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.599003 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.599323 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.599650 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.600089 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.600290 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.600601 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.600911 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.601248 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.601564 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.601937 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.602252 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.602566 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.602884 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.603197 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.603514 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.603827 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.604129 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.604455 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.604825 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.605127 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.605455 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.605780 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.606090 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.606397 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.606725 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.607042 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.607352 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.607660 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.607969 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.608322 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.608635 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.608945 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.609298 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.609623 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.609940 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.610260 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.610570 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.610882 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.611213 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.611536 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.611854 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.612170 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.612489 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.612835 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.613713 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.614063 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.614474 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.614798 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.615114 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.615423 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.615739 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.616063 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.616666 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.617006 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.617360 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.617684 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.618050 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.618377 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.618718 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.619125 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.619402 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.619717 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.620039 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.620339 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.620651 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.621117 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.621315 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.621624 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.621940 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.622255 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.622562 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.622870 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.623176 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.623482 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.623803 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.624236 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.624426 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.624829 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.625263 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.625585 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.625896 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.626236 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.626521 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.626876 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.627190 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.627536 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.627863 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.628212 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.629170 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.629640 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.629982 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.630294 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.630604 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.630912 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.631230 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.631545 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.631859 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.632217 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.632533 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.632850 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.633191 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.633504 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.633819 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.634128 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.634457 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.634764 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.635074 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.635376 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.635692 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.636006 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.636315 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.636628 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.636995 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.637485 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.637798 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.638107 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.638415 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.638730 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.639043 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.639360 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.639696 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.640012 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.640337 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.640640 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.640954 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.641293 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.641601 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.641919 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.642255 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.642574 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.642881 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.643196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.643504 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.643812 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.644945 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.645194 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.645528 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.645914 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.646136 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.646445 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.646756 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.647095 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.647475 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.647795 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.648107 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.648417 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.648772 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.649121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.649495 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.649803 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.650126 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.650452 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.650770 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.651085 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.651399 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.651701 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.652030 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.652343 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.652661 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.652970 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.653303 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.653621 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.653947 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.654263 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.654587 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.654908 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.655233 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.655540 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.655852 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.656168 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.656483 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.656788 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.657125 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.657443 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.657765 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.658079 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.658395 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.658826 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.659145 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.659467 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.659812 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.660196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.660532 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.660851 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.661191 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.661505 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.661818 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.662152 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.662293 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO dbcounter [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Registered counter for database nova_api Aug 23 22:15:11.662456 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.662901 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.663217 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.663529 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.663836 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.664150 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.664464 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.664781 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.665125 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.665437 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.665859 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.666172 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.666490 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.666803 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.667117 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.667422 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.667735 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.668063 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.668366 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.668669 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.668975 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.669322 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.669635 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.669959 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.670379 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.670693 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.671001 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.671418 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.671733 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.672055 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.672382 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.672717 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.673037 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.673366 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.673693 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.673998 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.674329 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.674655 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.674972 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.675368 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.675645 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.675988 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.676292 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.677702 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.677702 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.677702 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.677702 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.678818 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.678818 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.678818 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.679022 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.679188 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.679509 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.679821 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.680129 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.680450 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.681019 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.682090 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.682090 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.682090 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.682486 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.682572 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.683436 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.683436 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.683618 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.683812 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.684136 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.684462 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.684774 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.685128 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.685447 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.685784 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.686069 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.686280 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_db.sqlalchemy.engines [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:15:11.686496 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.686698 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.687005 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.687337 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.687671 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.688001 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.688318 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.688657 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.688986 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.689336 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.689659 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.689988 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.690296 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.690603 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.691490 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.691967 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.692281 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.692693 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.693023 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.693358 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.693673 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.693978 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.694305 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.694428 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writer thread running {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:15:11.694620 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.694942 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.695261 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.695572 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.695880 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.696189 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.696536 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.696846 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.697203 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.697521 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.697850 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.698171 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.698490 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.698811 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.699132 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.699452 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.699770 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.700094 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.700407 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.700727 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.701040 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.701381 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.701956 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.702293 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.702613 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.702931 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.703248 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.703562 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.703880 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.704197 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.704515 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.704829 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.705174 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.705511 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.705840 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.706169 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.707646 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.707646 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.707906 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.708053 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.708334 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.708699 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.709014 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.709342 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.709666 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.709984 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.710301 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.710617 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.710932 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.711241 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.711602 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.711875 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.712193 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.712499 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.712816 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.713167 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.713513 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.713835 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.714151 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.714467 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.714787 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.715340 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.715658 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.716002 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.716333 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.716656 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.716982 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.717329 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.717676 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.717969 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.718277 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.718590 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.718902 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.719215 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.719541 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.719855 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.720167 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.720477 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.720791 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.721377 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.721730 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.722057 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.722505 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.722842 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.723165 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.723476 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.723798 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.724111 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.724421 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.724741 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.725073 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.725385 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.725694 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.726008 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.726367 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.726632 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.726946 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.727252 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.727586 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.727897 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.728240 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.728580 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.728921 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.729259 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.729569 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.729921 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.730266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.730588 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.730896 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.731213 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.731521 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.731843 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.732180 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.732489 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.732804 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.733295 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.733820 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.734186 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.734519 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.734838 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.735177 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.735496 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.735818 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.736176 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.736500 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.737118 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.737462 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.737805 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.738222 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.738558 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.739039 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.739356 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.739667 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.739999 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.740319 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.740636 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.740954 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.741296 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.741619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.741937 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.742262 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.742579 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.742895 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.743206 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.743525 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.743840 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.744227 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.744850 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.745235 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.745594 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.745927 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.746259 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.746658 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.746988 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.747305 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.747624 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.747940 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.748256 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.748580 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.748915 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.749257 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.749570 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.750009 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.750319 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.750653 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.750982 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.751293 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.751625 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.751962 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.752269 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.752601 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.752918 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.753279 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.754252 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.754659 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.755041 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.755601 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.756002 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.756148 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.context [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c6226fde-aea4-42e2-ab82-e776e5887d31(cell1) {{(pid=105810) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 22:15:11.756325 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.756707 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.757050 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.757391 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.757720 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.758037 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.758355 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.758670 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.758983 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.759294 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.759715 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.760037 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.760345 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.760450 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:15:11.760648 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.760941 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:15:11.761034 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.761288 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.761602 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.761946 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.762268 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.762574 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:15:11.762693 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.762911 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.763223 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.763346 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:15:11.763536 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.763779 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:15:11.763896 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.764181 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.764517 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.764840 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.765216 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.767563 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.767712 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:15:11.767817 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.767817 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.767817 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.767817 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.767817 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.767817 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.767817 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.768306 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO dbcounter [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Registered counter for database nova_cell0 Aug 23 22:15:11.768377 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.768377 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.768671 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.768988 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.769882 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.770200 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.770547 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.773025 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.773025 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.773025 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.773025 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.773025 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.773025 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.773025 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.773616 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.773616 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.773958 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.774281 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.774601 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.774890 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO dbcounter [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Registered counter for database nova_cell1 Aug 23 22:15:11.774982 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.775228 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.775546 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.775865 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.776196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.776513 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.776853 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.777333 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.777635 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.777899 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.778237 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.778591 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.779481 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.779481 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.779733 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.779942 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.780198 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.780597 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:15:11.780758 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:15:11.783529 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_db.sqlalchemy.engines [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:15:11.786178 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_db.sqlalchemy.engines [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:15:11.791592 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writer thread running {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:15:11.796953 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writer thread running {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:15:11.934112 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO dbcounter [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Registered counter for database nova_api Aug 23 22:15:11.947443 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO dbcounter [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Registered counter for database nova_cell0 Aug 23 22:15:11.954778 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_db.sqlalchemy.engines [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:15:11.956593 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG oslo_db.sqlalchemy.engines [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:15:11.960157 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writer thread running {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:15:11.964455 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writer thread running {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:15:12.025915 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.context [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c6226fde-aea4-42e2-ab82-e776e5887d31(cell1) {{(pid=105809) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 22:15:12.029825 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG oslo_concurrency.lockutils [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:15:12.030302 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG oslo_concurrency.lockutils [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:15:12.031895 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG oslo_concurrency.lockutils [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:15:12.032629 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG oslo_concurrency.lockutils [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:15:12.033082 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG oslo_concurrency.lockutils [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:15:12.036354 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG oslo_concurrency.lockutils [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:15:12.038464 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO dbcounter [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Registered counter for database nova_cell0 Aug 23 22:15:12.044143 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO dbcounter [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Registered counter for database nova_cell1 Aug 23 22:15:12.054610 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG oslo_db.sqlalchemy.engines [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:15:12.057847 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG oslo_db.sqlalchemy.engines [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:15:12.062130 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writer thread running {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:15:12.069506 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writer thread running {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:15:12.218569 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO dbcounter [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Registered counter for database nova_cell0 Aug 23 22:15:12.230019 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG oslo_db.sqlalchemy.engines [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:15:12.234627 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writer thread running {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:15:12.309515 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: WARNING keystonemiddleware.auth_token [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:15:12.317406 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: WARNING keystonemiddleware.auth_token [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:15:12.569266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: WARNING keystonemiddleware.auth_token [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:15:12.577196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: WARNING keystonemiddleware.auth_token [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:15:12.671095 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: WARNING keystonemiddleware.auth_token [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:15:12.677784 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: WARNING keystonemiddleware.auth_token [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:15:12.684095 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e9c91fc9c0 pid: 105810 (default app) Aug 23 22:15:12.686553 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:15:12.687858 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] 10.222.0.88 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002103 Aug 23 22:15:12.688306 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 788 bytes} [Tue Aug 23 22:15:12 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:15:12.946947 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: WARNING keystonemiddleware.auth_token [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:15:12.953079 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: WARNING keystonemiddleware.auth_token [None req-411447ee-91a0-4a5d-9200-23a8f2d0cc96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:15:12.961020 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e9c91fc9c0 pid: 105809 (default app) Aug 23 22:16:47.526368 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:16:47.528157 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002378 Aug 23 22:16:47.528670 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 2/2] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:16:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:16:47.545547 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writing DB stats nova_api:SELECT=3 {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:47.546927 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writing DB stats nova_cell0:SELECT=3 {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:47.547676 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writing DB stats nova_cell1:SELECT=3 {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:47.549173 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writing DB stats nova_cell0:SELECT=3 {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:48.875214 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-36cd9b49-2b26-42be-bd3a-bbe665121cf0 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:16:48.929851 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-36cd9b49-2b26-42be-bd3a-bbe665121cf0 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.389322 Aug 23 22:16:48.931035 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 1/3] 10.222.0.88 () {60 vars in 1292 bytes} [Tue Aug 23 22:16:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:16:52.419396 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:16:52.420948 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-62332b7d-b5e6-40ba-a8bd-48e63b35e016 None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Aug 23 22:16:52.425481 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 3/4] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:16:52 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:16:53.013123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-5fd680f8-749e-43b3-a746-c451d9fe76d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1"}} {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:16:53.050457 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:16:53.050457 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: warnings.warn(msg) Aug 23 22:16:53.124348 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-5fd680f8-749e-43b3-a746-c451d9fe76d8 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.686436 Aug 23 22:16:53.124348 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 2/5] 10.222.0.88 () {64 vars in 1283 bytes} [Tue Aug 23 22:16:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:16:53.596779 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-981eca7d-1f27-4909-8717-2b50eb7b7865 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:16:53.605878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:16:53.605878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: warnings.warn(msg) Aug 23 22:16:53.611116 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_api:SELECT=3 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:53.612467 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_cell0:SELECT=3 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:53.616047 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_cell1:SELECT=3 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:53.617324 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:53.701442 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-981eca7d-1f27-4909-8717-2b50eb7b7865 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.564051 Aug 23 22:16:53.703265 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 4/6] 10.222.0.88 () {64 vars in 1336 bytes} [Tue Aug 23 22:16:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:16:56.950435 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-5fd680f8-749e-43b3-a746-c451d9fe76d8 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:16:56.952667 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-5fd680f8-749e-43b3-a746-c451d9fe76d8 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002947 Aug 23 22:16:56.958529 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 3/7] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:16:58.178793 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-88779c48-1d92-49aa-b4e1-25c760384f7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "swap": 0}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:16:58.202373 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:16:58.202373 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: warnings.warn(msg) Aug 23 22:16:58.236395 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-88779c48-1d92-49aa-b4e1-25c760384f7a admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.270811 Aug 23 22:16:58.237464 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 5/8] 10.222.0.88 () {64 vars in 1283 bytes} [Tue Aug 23 22:16:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:16:58.251209 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-cefce32d-0701-476c-8e0c-b4213d4f2ea9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:16:58.254258 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:16:58.254258 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: warnings.warn(msg) Aug 23 22:16:58.298333 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-cefce32d-0701-476c-8e0c-b4213d4f2ea9 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051089 Aug 23 22:16:58.298995 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 4/9] 10.222.0.88 () {64 vars in 1336 bytes} [Tue Aug 23 22:16:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:17:01.383008 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-88779c48-1d92-49aa-b4e1-25c760384f7a admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:01.383917 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-88779c48-1d92-49aa-b4e1-25c760384f7a admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 23 22:17:01.384553 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 6/10] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:17:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:02.139276 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-b9796d61-22ac-4347-9ea1-1c2572ea7832 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:02.170808 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-b9796d61-22ac-4347-9ea1-1c2572ea7832 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.777735 Aug 23 22:17:02.177546 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 5/11] 10.222.0.88 () {64 vars in 1283 bytes} [Tue Aug 23 22:17:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:17:02.204649 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-a6fe8b25-3011-442f-a947-1b07475c2528 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:02.284910 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-a6fe8b25-3011-442f-a947-1b07475c2528 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097999 Aug 23 22:17:02.286605 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 7/12] 10.222.0.88 () {64 vars in 1336 bytes} [Tue Aug 23 22:17:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:17:05.224200 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-b9796d61-22ac-4347-9ea1-1c2572ea7832 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:05.225500 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-b9796d61-22ac-4347-9ea1-1c2572ea7832 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002226 Aug 23 22:17:05.227244 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 6/13] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:17:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:05.797168 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-afa9914d-ae99-43cf-97ed-438ceb87eb7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "vcpus": 2}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:05.821420 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-afa9914d-ae99-43cf-97ed-438ceb87eb7e admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.588165 Aug 23 22:17:05.822354 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 8/14] 10.222.0.88 () {64 vars in 1283 bytes} [Tue Aug 23 22:17:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:17:05.835134 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-822347e5-cfb9-4af1-ac42-c2c8d9f50438 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:05.868999 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-822347e5-cfb9-4af1-ac42-c2c8d9f50438 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037500 Aug 23 22:17:05.870233 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 7/15] 10.222.0.88 () {64 vars in 1336 bytes} [Tue Aug 23 22:17:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:17:08.824825 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-afa9914d-ae99-43cf-97ed-438ceb87eb7e admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:08.826075 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-afa9914d-ae99-43cf-97ed-438ceb87eb7e admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001923 Aug 23 22:17:08.826853 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 9/16] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:17:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:17:09.498018 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-1c63d851-f0d1-48f0-8821-e7ddaaf3490b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:09.546906 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-1c63d851-f0d1-48f0-8821-e7ddaaf3490b admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.710045 Aug 23 22:17:09.548681 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 8/17] 10.222.0.88 () {64 vars in 1283 bytes} [Tue Aug 23 22:17:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:17:09.563783 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-d19bdc1e-cfbd-4bff-8f3b-79d4da3a8b1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:09.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-d19bdc1e-cfbd-4bff-8f3b-79d4da3a8b1c admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064719 Aug 23 22:17:09.643175 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 10/18] 10.222.0.88 () {64 vars in 1336 bytes} [Tue Aug 23 22:17:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:17:12.501866 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-1c63d851-f0d1-48f0-8821-e7ddaaf3490b admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:12.502971 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-1c63d851-f0d1-48f0-8821-e7ddaaf3490b admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Aug 23 22:17:12.503410 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 9/19] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:17:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:17:13.215418 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-7729e3b0-365f-4682-8a54-b799eabb302a admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:13.253219 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-7729e3b0-365f-4682-8a54-b799eabb302a admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.740423 Aug 23 22:17:13.253845 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 11/20] 10.222.0.88 () {60 vars in 1292 bytes} [Tue Aug 23 22:17:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:17:16.151342 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-1c63d851-f0d1-48f0-8821-e7ddaaf3490b admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:16.152882 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-1c63d851-f0d1-48f0-8821-e7ddaaf3490b admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002284 Aug 23 22:17:16.153429 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 10/21] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:17:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:16.743991 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-fc72ff2c-2889-43e7-99b6-78050bb13d16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "id": "1", "rxtx_factor": 1.0}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:16.772749 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-fc72ff2c-2889-43e7-99b6-78050bb13d16 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.610944 Aug 23 22:17:16.773318 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 12/22] 10.222.0.88 () {64 vars in 1283 bytes} [Tue Aug 23 22:17:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:17:16.793459 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-504bcb18-4385-4b7c-ab9c-e4b0bbda2ceb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:16.838751 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-504bcb18-4385-4b7c-ab9c-e4b0bbda2ceb admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054113 Aug 23 22:17:16.839472 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 11/23] 10.222.0.88 () {64 vars in 1333 bytes} [Tue Aug 23 22:17:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:17:19.668622 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-fc72ff2c-2889-43e7-99b6-78050bb13d16 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:19.670090 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-fc72ff2c-2889-43e7-99b6-78050bb13d16 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001810 Aug 23 22:17:19.670577 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 13/24] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:17:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:20.227112 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-07434f13-1709-4680-8dc1-2f638c928c33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:20.237223 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:20.266361 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-07434f13-1709-4680-8dc1-2f638c928c33 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.587322 Aug 23 22:17:20.267032 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 12/25] 10.222.0.88 () {64 vars in 1283 bytes} [Tue Aug 23 22:17:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:17:20.282211 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-b02ccfb2-4022-4124-adbb-bc1ba301bf14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:20.315030 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-b02ccfb2-4022-4124-adbb-bc1ba301bf14 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037722 Aug 23 22:17:20.315955 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 14/26] 10.222.0.88 () {64 vars in 1333 bytes} [Tue Aug 23 22:17:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:17:23.186732 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-07434f13-1709-4680-8dc1-2f638c928c33 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:23.188438 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-07434f13-1709-4680-8dc1-2f638c928c33 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002537 Aug 23 22:17:23.188861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 13/27] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:17:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:23.831250 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-507482af-338a-4c08-ae41-3333c35bccb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:23.838466 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:23.860618 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-507482af-338a-4c08-ae41-3333c35bccb3 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.664000 Aug 23 22:17:23.861510 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 15/28] 10.222.0.88 () {64 vars in 1283 bytes} [Tue Aug 23 22:17:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:17:23.874274 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-773dec6f-70f5-45f2-b7a6-484b2b945505 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:23.907487 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-773dec6f-70f5-45f2-b7a6-484b2b945505 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036912 Aug 23 22:17:23.908498 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 14/29] 10.222.0.88 () {64 vars in 1333 bytes} [Tue Aug 23 22:17:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:17:26.525484 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-507482af-338a-4c08-ae41-3333c35bccb3 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:26.526533 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-507482af-338a-4c08-ae41-3333c35bccb3 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 23 22:17:26.527169 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 16/30] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:17:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:27.039611 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-aeb0301f-6aac-4376-a90e-80c2478b085d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:27.066150 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-aeb0301f-6aac-4376-a90e-80c2478b085d admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.531541 Aug 23 22:17:27.069113 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 15/31] 10.222.0.88 () {64 vars in 1283 bytes} [Tue Aug 23 22:17:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:17:27.080898 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-3a7c49a4-5553-47bc-ad9c-3ba7fc5cc73f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:27.110654 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-3a7c49a4-5553-47bc-ad9c-3ba7fc5cc73f admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033026 Aug 23 22:17:27.119033 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 17/32] 10.222.0.88 () {64 vars in 1333 bytes} [Tue Aug 23 22:17:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:17:29.705621 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-aeb0301f-6aac-4376-a90e-80c2478b085d admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:29.706841 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-aeb0301f-6aac-4376-a90e-80c2478b085d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004775 Aug 23 22:17:29.707278 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 16/33] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:17:29 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:30.338275 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-f499083c-2b0b-4ee9-bf26-4efa61fcdf8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "swap": 0}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:30.366929 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-f499083c-2b0b-4ee9-bf26-4efa61fcdf8c admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.648855 Aug 23 22:17:30.367474 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 18/34] 10.222.0.88 () {64 vars in 1283 bytes} [Tue Aug 23 22:17:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:17:30.380394 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-ab80b1da-0182-4ec3-9509-1884431c5ace admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:30.418256 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-ab80b1da-0182-4ec3-9509-1884431c5ace admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042116 Aug 23 22:17:30.419643 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 17/35] 10.222.0.88 () {64 vars in 1333 bytes} [Tue Aug 23 22:17:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:17:49.299376 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-f499083c-2b0b-4ee9-bf26-4efa61fcdf8c admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:49.300391 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-f499083c-2b0b-4ee9-bf26-4efa61fcdf8c admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 23 22:17:49.300796 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 19/36] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:49.313614 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:49.877361 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-d4d2ffb3-ee2f-4ed7-bded-6c6bd59daca9 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:49.900668 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-d4d2ffb3-ee2f-4ed7-bded-6c6bd59daca9 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.592095 Aug 23 22:17:49.901268 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 18/37] 10.222.0.88 () {60 vars in 1292 bytes} [Tue Aug 23 22:17:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:17:51.211171 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-f499083c-2b0b-4ee9-bf26-4efa61fcdf8c admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:51.212204 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-f499083c-2b0b-4ee9-bf26-4efa61fcdf8c admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 23 22:17:51.212603 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 20/38] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:17:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:51.916349 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-47bad651-4de5-4595-b6fd-5811da5cabd7 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:51.923027 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.wsgi [None req-47bad651-4de5-4595-b6fd-5811da5cabd7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-47bad651-4de5-4595-b6fd-5811da5cabd7 admin admin] Request method failure captured: Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Accept: application/json Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Accept-Encoding: gzip, deflate Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Connection: keep-alive Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Content-Length: 0 Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Host: 10.222.0.88 Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Openstack-Api-Version: compute 2.90 Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Openstack-System-Scope: None Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: User-Agent: python-novaclient Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Auth-Token: gAAAAABjBVIP1VCddb_-NcN783L6nTIfTc4_uM_x37w2Oa0yG5QOSXeq-tH1LsBQUA4riagWDRVLffMl0iuF7aUfKDqpEeO2zPevsmJjcnyEXnc4DnwRQqejH69B3Cs42-GZK6SBx0IzwrlhKCpMz9khxbKov4qge15gmFqvrRVn2-MsbABAteM Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Domain-Id: None Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Domain-Name: None Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Identity-Status: Confirmed Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Is-Admin-Project: True Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Domain-Id: default Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Domain-Name: Default Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Name: admin Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Role: member,reader,admin Aug 23 22:17:51.926762 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Roles: member,reader,admin Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}] Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Tenant: admin Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Tenant-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Tenant-Name: admin Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User: admin Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Domain-Id: default Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Domain-Name: Default Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Id: a7b11924f137447a8c88ac81ee52e9ff Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Name: admin Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: method: > Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: exception: Flavor 42 could not be found. Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: action_args: {'id': '42'} Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:17:51.929769 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:51.931682 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:51.934861 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-47bad651-4de5-4595-b6fd-5811da5cabd7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:17:51.936584 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-47bad651-4de5-4595-b6fd-5811da5cabd7 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.575003 Aug 23 22:17:51.936584 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 19/39] 10.222.0.88 () {60 vars in 1190 bytes} [Tue Aug 23 22:17:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 581 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 22:17:51.939227 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-d94287d6-3db0-4a34-a9aa-92a4f1b89bd0 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:51.944281 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:51.966016 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-d94287d6-3db0-4a34-a9aa-92a4f1b89bd0 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030385 Aug 23 22:17:51.966603 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 21/40] 10.222.0.88 () {60 vars in 1210 bytes} [Tue Aug 23 22:17:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:17:51.979129 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-8b9ae339-4c4f-4ec2-823a-119684f62f76 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:52.007432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-8b9ae339-4c4f-4ec2-823a-119684f62f76 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032612 Aug 23 22:17:52.008001 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 20/41] 10.222.0.88 () {60 vars in 1210 bytes} [Tue Aug 23 22:17:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:17:52.018500 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-ee9b2c33-89af-4edd-b281-8581920e551d admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:52.025802 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.wsgi [None req-ee9b2c33-89af-4edd-b281-8581920e551d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-ee9b2c33-89af-4edd-b281-8581920e551d admin admin] Request method failure captured: Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Accept: application/json Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Accept-Encoding: gzip, deflate Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Connection: keep-alive Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Content-Length: 0 Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Host: 10.222.0.88 Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Openstack-Api-Version: compute 2.90 Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Openstack-System-Scope: None Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: User-Agent: python-novaclient Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Auth-Token: gAAAAABjBVIP1VCddb_-NcN783L6nTIfTc4_uM_x37w2Oa0yG5QOSXeq-tH1LsBQUA4riagWDRVLffMl0iuF7aUfKDqpEeO2zPevsmJjcnyEXnc4DnwRQqejH69B3Cs42-GZK6SBx0IzwrlhKCpMz9khxbKov4qge15gmFqvrRVn2-MsbABAteM Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Domain-Id: None Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Domain-Name: None Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Identity-Status: Confirmed Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Is-Admin-Project: True Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Domain-Id: default Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Domain-Name: Default Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Name: admin Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Role: member,reader,admin Aug 23 22:17:52.029411 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Roles: member,reader,admin Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}] Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Tenant: admin Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Tenant-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Tenant-Name: admin Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User: admin Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Domain-Id: default Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Domain-Name: Default Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Id: a7b11924f137447a8c88ac81ee52e9ff Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Name: admin Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: method: > Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: exception: Flavor 42 could not be found. Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: action_args: {'id': '42'} Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:17:52.032131 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:52.033878 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:52.036152 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-ee9b2c33-89af-4edd-b281-8581920e551d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:17:52.038213 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-ee9b2c33-89af-4edd-b281-8581920e551d admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016543 Aug 23 22:17:52.038213 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 22/42] 10.222.0.88 () {60 vars in 1190 bytes} [Tue Aug 23 22:17:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 22:17:53.249705 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-8b9ae339-4c4f-4ec2-823a-119684f62f76 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:53.250807 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-8b9ae339-4c4f-4ec2-823a-119684f62f76 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Aug 23 22:17:53.251215 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 21/43] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:53.917565 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-b043e004-b45b-49eb-9960-7ab6d4af965d admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:53.924516 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.wsgi [None req-b043e004-b45b-49eb-9960-7ab6d4af965d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-b043e004-b45b-49eb-9960-7ab6d4af965d admin admin] Request method failure captured: Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Accept: application/json Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Accept-Encoding: gzip, deflate Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Connection: keep-alive Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Content-Length: 0 Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Host: 10.222.0.88 Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Openstack-Api-Version: compute 2.90 Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Openstack-System-Scope: None Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: User-Agent: python-novaclient Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Auth-Token: gAAAAABjBVIRNI-XlEdhpJ8h0pTK-1qL_SkUs_eBORps5LOPPuh0T5tJQljcWw36zfZoLbFFjaOf5ME2bQuDGDqBpreTuZULTH6Pmfh69IGsYy6wVxn9hKzRtsC73X_Wy1LUMjBUiEW24ML8pbWIRCfdqQinsjFaQk22quh5p01ZoWgea61G26I Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Domain-Id: None Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Domain-Name: None Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Identity-Status: Confirmed Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Is-Admin-Project: True Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Domain-Id: default Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Domain-Name: Default Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Name: admin Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Role: member,reader,admin Aug 23 22:17:53.926416 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Roles: member,reader,admin Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}] Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Tenant: admin Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Tenant-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Tenant-Name: admin Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User: admin Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Domain-Id: default Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Domain-Name: Default Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Id: a7b11924f137447a8c88ac81ee52e9ff Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Name: admin Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: method: > Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: exception: Flavor 84 could not be found. Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: action_args: {'id': '84'} Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:17:53.929877 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:53.931581 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:53.933523 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-b043e004-b45b-49eb-9960-7ab6d4af965d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:17:53.935849 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-b043e004-b45b-49eb-9960-7ab6d4af965d admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.532311 Aug 23 22:17:53.935849 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 23/44] 10.222.0.88 () {60 vars in 1190 bytes} [Tue Aug 23 22:17:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 534 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:53.942587 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-598eb1ee-3ca9-433e-9467-84faaaff40b8 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:53.959981 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-598eb1ee-3ca9-433e-9467-84faaaff40b8 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021819 Aug 23 22:17:53.960570 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 22/45] 10.222.0.88 () {60 vars in 1210 bytes} [Tue Aug 23 22:17:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:17:53.972703 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-76d5d59b-0111-4524-ad03-624ca4884911 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:53.993910 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-76d5d59b-0111-4524-ad03-624ca4884911 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025184 Aug 23 22:17:53.994663 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 24/46] 10.222.0.88 () {60 vars in 1210 bytes} [Tue Aug 23 22:17:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:17:54.007196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-dd2e7f2a-ca4a-4098-9b05-cba6a43845e2 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:54.016365 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.wsgi [None req-dd2e7f2a-ca4a-4098-9b05-cba6a43845e2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-dd2e7f2a-ca4a-4098-9b05-cba6a43845e2 admin admin] Request method failure captured: Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Accept: application/json Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Accept-Encoding: gzip, deflate Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Connection: keep-alive Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Content-Length: 0 Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Host: 10.222.0.88 Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Openstack-Api-Version: compute 2.90 Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Openstack-System-Scope: None Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: User-Agent: python-novaclient Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Auth-Token: gAAAAABjBVIRNI-XlEdhpJ8h0pTK-1qL_SkUs_eBORps5LOPPuh0T5tJQljcWw36zfZoLbFFjaOf5ME2bQuDGDqBpreTuZULTH6Pmfh69IGsYy6wVxn9hKzRtsC73X_Wy1LUMjBUiEW24ML8pbWIRCfdqQinsjFaQk22quh5p01ZoWgea61G26I Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Domain-Id: None Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Domain-Name: None Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Identity-Status: Confirmed Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Is-Admin-Project: True Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Domain-Id: default Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Domain-Name: Default Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Name: admin Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Role: member,reader,admin Aug 23 22:17:54.018196 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Roles: member,reader,admin Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}] Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Tenant: admin Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Tenant-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Tenant-Name: admin Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User: admin Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Domain-Id: default Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Domain-Name: Default Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Id: a7b11924f137447a8c88ac81ee52e9ff Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Name: admin Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: method: > Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: exception: Flavor 84 could not be found. Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: action_args: {'id': '84'} Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:17:54.020619 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:54.021809 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:54.024121 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-dd2e7f2a-ca4a-4098-9b05-cba6a43845e2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:17:54.026093 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-dd2e7f2a-ca4a-4098-9b05-cba6a43845e2 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017217 Aug 23 22:17:54.026093 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 23/47] 10.222.0.88 () {60 vars in 1190 bytes} [Tue Aug 23 22:17:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 22:17:55.131196 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-76d5d59b-0111-4524-ad03-624ca4884911 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:55.132573 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-76d5d59b-0111-4524-ad03-624ca4884911 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002139 Aug 23 22:17:55.133123 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 25/48] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:17:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:55.875525 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-6f4ab786-0958-4a25-9b88-602a5367ada7 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:55.883431 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.wsgi [None req-6f4ab786-0958-4a25-9b88-602a5367ada7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-6f4ab786-0958-4a25-9b88-602a5367ada7 admin admin] Request method failure captured: Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Accept: application/json Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Accept-Encoding: gzip, deflate Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Connection: keep-alive Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Content-Length: 0 Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Host: 10.222.0.88 Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Openstack-Api-Version: compute 2.90 Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Openstack-System-Scope: None Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: User-Agent: python-novaclient Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Auth-Token: gAAAAABjBVISvt500FJu4c35GKH9WnOLOJvH8Jmsf0ktT2uLm64mQ4BJjnmPWKmZq52yhpIi7SbyyPW-f7rM4DiCedJ4uaRNjDM6iNpAckwCEW9wTPYOMogngWD3NyPd3s9wBwPLMs8v47KLn2Fqitc61HGQsk9_-k8yZGjseMz9hVVKERRIh90 Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Domain-Id: None Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Domain-Name: None Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Identity-Status: Confirmed Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Is-Admin-Project: True Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Domain-Id: default Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Domain-Name: Default Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Project-Name: admin Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Role: member,reader,admin Aug 23 22:17:55.885432 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Roles: member,reader,admin Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}] Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Tenant: admin Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Tenant-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-Tenant-Name: admin Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User: admin Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Domain-Id: default Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Domain-Name: Default Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Id: a7b11924f137447a8c88ac81ee52e9ff Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: X-User-Name: admin Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: method: > Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: exception: Flavor 451 could not be found. Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: action_args: {'id': '451'} Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:17:55.887266 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:55.888550 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: ERROR nova.api.openstack.wsgi Aug 23 22:17:55.890123 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-6f4ab786-0958-4a25-9b88-602a5367ada7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:17:55.891485 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-6f4ab786-0958-4a25-9b88-602a5367ada7 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.596784 Aug 23 22:17:55.891485 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 24/49] 10.222.0.88 () {60 vars in 1193 bytes} [Tue Aug 23 22:17:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 599 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:55.899673 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-f9291ce3-737b-4ccc-a1d8-ab95f791702a admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:55.916608 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-f9291ce3-737b-4ccc-a1d8-ab95f791702a admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020558 Aug 23 22:17:55.917201 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 26/50] 10.222.0.88 () {60 vars in 1210 bytes} [Tue Aug 23 22:17:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:17:55.931173 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:55.952830 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028810 Aug 23 22:17:55.953452 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 25/51] 10.222.0.88 () {60 vars in 1210 bytes} [Tue Aug 23 22:17:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:17:55.969631 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-d82d096b-73cd-4ecc-ba7c-e5b0270c2b9d admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:55.976896 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.wsgi [None req-d82d096b-73cd-4ecc-ba7c-e5b0270c2b9d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-d82d096b-73cd-4ecc-ba7c-e5b0270c2b9d admin admin] Request method failure captured: Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Accept: application/json Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Accept-Encoding: gzip, deflate Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Connection: keep-alive Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Content-Length: 0 Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Host: 10.222.0.88 Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Openstack-Api-Version: compute 2.90 Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Openstack-System-Scope: None Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: User-Agent: python-novaclient Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Auth-Token: gAAAAABjBVISvt500FJu4c35GKH9WnOLOJvH8Jmsf0ktT2uLm64mQ4BJjnmPWKmZq52yhpIi7SbyyPW-f7rM4DiCedJ4uaRNjDM6iNpAckwCEW9wTPYOMogngWD3NyPd3s9wBwPLMs8v47KLn2Fqitc61HGQsk9_-k8yZGjseMz9hVVKERRIh90 Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Domain-Id: None Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Domain-Name: None Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Identity-Status: Confirmed Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Is-Admin-Project: True Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Domain-Id: default Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Domain-Name: Default Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Project-Name: admin Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Role: member,reader,admin Aug 23 22:17:55.978611 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Roles: member,reader,admin Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fe428a23adc74bbab88ff935243cc4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fe428a23adc74bbab88ff935243cc4e2"}]}] Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Tenant: admin Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Tenant-Id: fe428a23adc74bbab88ff935243cc4e2 Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-Tenant-Name: admin Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User: admin Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Domain-Id: default Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Domain-Name: Default Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Id: a7b11924f137447a8c88ac81ee52e9ff Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: X-User-Name: admin Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: method: > Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: exception: Flavor 451 could not be found. Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: action_args: {'id': '451'} Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:17:55.980263 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:55.981277 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: ERROR nova.api.openstack.wsgi Aug 23 22:17:55.982732 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-d82d096b-73cd-4ecc-ba7c-e5b0270c2b9d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:17:55.984138 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-d82d096b-73cd-4ecc-ba7c-e5b0270c2b9d admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017452 Aug 23 22:17:55.984138 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 27/52] 10.222.0.88 () {60 vars in 1193 bytes} [Tue Aug 23 22:17:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:57.107171 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:57.109090 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002445 Aug 23 22:17:57.110143 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 26/53] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:17:57 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:57.839317 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-eacbbc4f-b2c9-496f-8a07-c19341816690 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:57.862413 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-eacbbc4f-b2c9-496f-8a07-c19341816690 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.574309 Aug 23 22:17:57.863079 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 28/54] 10.222.0.88 () {64 vars in 1235 bytes} [Tue Aug 23 22:17:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:17:59.044660 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:17:59.045736 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 23 22:17:59.046172 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 27/55] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:17:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:17:59.686235 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-2d808c30-3738-40e6-afa4-d86b30a2b650 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:17:59.709636 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-2d808c30-3738-40e6-afa4-d86b30a2b650 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.518238 Aug 23 22:17:59.709636 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 29/56] 10.222.0.88 () {64 vars in 1235 bytes} [Tue Aug 23 22:17:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:18:00.718688 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:18:00.719699 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 23 22:18:00.720103 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 28/57] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:18:01.277229 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-4d24c415-87d8-48f2-b98d-01fdddf6c77b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:18:01.297210 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-4d24c415-87d8-48f2-b98d-01fdddf6c77b admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.436568 Aug 23 22:18:01.297754 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 30/58] 10.222.0.88 () {64 vars in 1235 bytes} [Tue Aug 23 22:18:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:18:02.303238 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:18:02.304253 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 23 22:18:02.304662 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 29/59] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:18:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:18:02.950111 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-2653776f-6dbe-43ce-8429-684ed6c001cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:18:02.972658 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-2653776f-6dbe-43ce-8429-684ed6c001cd admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.526552 Aug 23 22:18:02.974544 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 31/60] 10.222.0.88 () {64 vars in 1235 bytes} [Tue Aug 23 22:18:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:18:04.036617 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:18:04.037668 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 23 22:18:04.038072 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 30/61] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:18:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:18:04.598960 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-84d7452c-3802-4a08-92af-d262f6ddb14b admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:18:04.620298 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-84d7452c-3802-4a08-92af-d262f6ddb14b admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.444338 Aug 23 22:18:04.620888 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 32/62] 10.222.0.88 () {60 vars in 1202 bytes} [Tue Aug 23 22:18:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:19:04.098923 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:19:04.099920 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-61850d73-c53e-4873-a55d-b7696471ddd3 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 23 22:19:04.100316 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 31/63] 10.222.0.88 () {54 vars in 931 bytes} [Tue Aug 23 22:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:19:04.110980 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:04.533995 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-0fed4662-002b-4aa4-8065-a051b2994a68 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:19:04.556189 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-0fed4662-002b-4aa4-8065-a051b2994a68 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.449676 Aug 23 22:19:04.556737 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 33/64] 10.222.0.88 () {60 vars in 1292 bytes} [Tue Aug 23 22:19:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:19:04.578218 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG dbcounter [-] [105809] Writing DB stats nova_api:SELECT=14 {{(pid=105809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:04.582628 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-1169bbb2-9fce-430a-ab2f-c6f424fd448c admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:19:04.590776 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-1169bbb2-9fce-430a-ab2f-c6f424fd448c admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013961 Aug 23 22:19:04.591349 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 32/65] 10.222.0.88 () {60 vars in 1283 bytes} [Tue Aug 23 22:19:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:19:04.604081 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-95443799-153d-44e3-bc50-debef6f8d3c6 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:19:04.611978 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-95443799-153d-44e3-bc50-debef6f8d3c6 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011494 Aug 23 22:19:04.612527 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 34/66] 10.222.0.88 () {60 vars in 1286 bytes} [Tue Aug 23 22:19:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:19:04.624818 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-1744e4c2-bf0a-41fb-ba16-f2163ef87fe2 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:19:04.632797 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-1744e4c2-bf0a-41fb-ba16-f2163ef87fe2 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011581 Aug 23 22:19:04.633392 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 33/67] 10.222.0.88 () {60 vars in 1286 bytes} [Tue Aug 23 22:19:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:19:04.645904 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-2ab5fdb9-af27-4df6-befc-dd079e67e209 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:19:04.653758 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-2ab5fdb9-af27-4df6-befc-dd079e67e209 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012017 Aug 23 22:19:04.654305 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 35/68] 10.222.0.88 () {60 vars in 1283 bytes} [Tue Aug 23 22:19:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:22:10.638859 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-1744e4c2-bf0a-41fb-ba16-f2163ef87fe2 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:22:10.639880 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-1744e4c2-bf0a-41fb-ba16-f2163ef87fe2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 23 22:22:10.640281 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 34/69] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:22:10.786860 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_api:SELECT=6 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:10.943729 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-7292d972-95e3-4303-b5c9-14f174a7eb03 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:22:10.945975 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:22:10.945975 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: warnings.warn(msg) Aug 23 22:22:10.947136 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-7292d972-95e3-4303-b5c9-14f174a7eb03 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:10.947762 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-7292d972-95e3-4303-b5c9-14f174a7eb03 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:10.948199 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-7292d972-95e3-4303-b5c9-14f174a7eb03 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:10.948923 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-7292d972-95e3-4303-b5c9-14f174a7eb03 admin admin] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:10.949398 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-7292d972-95e3-4303-b5c9-14f174a7eb03 admin admin] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:10.949827 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-7292d972-95e3-4303-b5c9-14f174a7eb03 admin admin] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:10.986294 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-7292d972-95e3-4303-b5c9-14f174a7eb03 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200900 Aug 23 22:22:10.986957 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 36/70] 10.222.0.88 () {60 vars in 1193 bytes} [Tue Aug 23 22:22:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:22:11.843526 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-1744e4c2-bf0a-41fb-ba16-f2163ef87fe2 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:22:11.845344 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-1744e4c2-bf0a-41fb-ba16-f2163ef87fe2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002148 Aug 23 22:22:11.845764 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 35/71] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:22:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:22:12.052950 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-da7dffeb-0410-42c5-b5eb-852fa63593d9 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:22:12.055406 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:22:12.055406 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: warnings.warn(msg) Aug 23 22:22:12.056545 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-da7dffeb-0410-42c5-b5eb-852fa63593d9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:12.057027 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-da7dffeb-0410-42c5-b5eb-852fa63593d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:12.057482 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-da7dffeb-0410-42c5-b5eb-852fa63593d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:12.058195 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-da7dffeb-0410-42c5-b5eb-852fa63593d9 admin admin] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:12.058641 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-da7dffeb-0410-42c5-b5eb-852fa63593d9 admin admin] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:12.059055 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-da7dffeb-0410-42c5-b5eb-852fa63593d9 admin admin] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:12.080784 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-da7dffeb-0410-42c5-b5eb-852fa63593d9 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090469 Aug 23 22:22:12.082468 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 37/72] 10.222.0.88 () {60 vars in 1193 bytes} [Tue Aug 23 22:22:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:22:23.324922 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-1744e4c2-bf0a-41fb-ba16-f2163ef87fe2 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:22:23.325982 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-1744e4c2-bf0a-41fb-ba16-f2163ef87fe2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 23 22:22:23.326536 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 36/73] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:22:23.473186 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_cell0:SELECT=4 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:23.473893 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_cell1:SELECT=4 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:23.474681 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG dbcounter [-] [105810] Writing DB stats nova_api:SELECT=8 {{(pid=105810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:23.525934 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-d37387b8-6fd7-4baf-a443-1441fc4b79ff admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:22:23.528326 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:22:23.528326 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: warnings.warn(msg) Aug 23 22:22:23.529707 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-d37387b8-6fd7-4baf-a443-1441fc4b79ff admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:23.530248 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-d37387b8-6fd7-4baf-a443-1441fc4b79ff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:23.530861 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-d37387b8-6fd7-4baf-a443-1441fc4b79ff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:23.531578 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-d37387b8-6fd7-4baf-a443-1441fc4b79ff admin admin] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:23.532020 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-d37387b8-6fd7-4baf-a443-1441fc4b79ff admin admin] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:23.532434 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-d37387b8-6fd7-4baf-a443-1441fc4b79ff admin admin] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:23.559627 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-d37387b8-6fd7-4baf-a443-1441fc4b79ff admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091272 Aug 23 22:22:23.560332 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 38/74] 10.222.0.88 () {60 vars in 1193 bytes} [Tue Aug 23 22:22:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:22:24.406473 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: DEBUG nova.api.openstack.wsgi [None req-1744e4c2-bf0a-41fb-ba16-f2163ef87fe2 admin admin] Calling method '>' {{(pid=105809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:22:24.407513 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: INFO nova.api.openstack.requestlog [None req-1744e4c2-bf0a-41fb-ba16-f2163ef87fe2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 23 22:22:24.408713 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: [pid: 105809|app: 0|req: 37/75] 10.222.0.88 () {56 vars in 1074 bytes} [Tue Aug 23 22:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:22:24.602515 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG nova.api.openstack.wsgi [None req-57b1185e-c27b-486a-9cb6-ca0947d10ae8 admin admin] Calling method '>' {{(pid=105810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:22:24.604891 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:22:24.604891 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: warnings.warn(msg) Aug 23 22:22:24.606124 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-57b1185e-c27b-486a-9cb6-ca0947d10ae8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:24.606597 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-57b1185e-c27b-486a-9cb6-ca0947d10ae8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:24.606977 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-57b1185e-c27b-486a-9cb6-ca0947d10ae8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:24.607692 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-57b1185e-c27b-486a-9cb6-ca0947d10ae8 admin admin] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:22:24.608142 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-57b1185e-c27b-486a-9cb6-ca0947d10ae8 admin admin] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:22:24.608561 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: DEBUG oslo_concurrency.lockutils [None req-57b1185e-c27b-486a-9cb6-ca0947d10ae8 admin admin] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:22:24.631895 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: INFO nova.api.openstack.requestlog [None req-57b1185e-c27b-486a-9cb6-ca0947d10ae8 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084310 Aug 23 22:22:24.632466 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: [pid: 105810|app: 0|req: 39/76] 10.222.0.88 () {60 vars in 1193 bytes} [Tue Aug 23 22:22:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:23:23.815834 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: Tue Aug 23 22:23:23 2022 - graceful shutdown triggered... Aug 23 22:23:23.815789 dv-cinder-850321-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 23 22:23:23.817017 dv-cinder-850321-4-iscsi devstack@n-api.service[105810]: Gracefully killing worker 2 (pid: 105810)... Aug 23 22:23:23.817438 dv-cinder-850321-4-iscsi devstack@n-api.service[105809]: Gracefully killing worker 1 (pid: 105809)... Aug 23 22:23:24.816846 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: worker 1 buried after 1 seconds Aug 23 22:23:24.816846 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: worker 2 buried after 1 seconds Aug 23 22:23:24.817565 dv-cinder-850321-4-iscsi devstack@n-api.service[105808]: goodbye to uWSGI. Aug 23 22:23:24.818552 dv-cinder-850321-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 23 22:23:24.819187 dv-cinder-850321-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 23 22:23:24.822205 dv-cinder-850321-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 22:23:24.832260 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 22:23:24 2022] *** Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: nodename: dv-cinder-850321-4-iscsi Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: machine: x86_64 Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: clock source: unix Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: pcre jit disabled Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: detected number of CPU cores: 4 Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: current working directory: / Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: detected binary path: /usr/bin/uwsgi-core Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: your processes number limit is 47680 Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: your memory page size is 4096 bytes Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: detected max file descriptor number: 2048 Aug 23 22:23:24.834270 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: lock engine: pthread robust mutexes Aug 23 22:23:24.835368 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: thunder lock: enabled Aug 23 22:23:24.835368 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 22:23:24.835368 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 22:23:24.877594 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: Python main interpreter initialized at 0x55bc1a4f49c0 Aug 23 22:23:24.877594 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: python threads support enabled Aug 23 22:23:24.877594 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: your server socket listen backlog is limited to 100 connections Aug 23 22:23:24.877594 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: your mercy for graceful operations on workers is 90 seconds Aug 23 22:23:24.878070 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 22:23:24.878070 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: *** Operational MODE: preforking *** Aug 23 22:23:24.878378 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: *** uWSGI is running in multiple interpreter mode *** Aug 23 22:23:24.878378 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: spawned uWSGI master process (pid: 120843) Aug 23 22:23:24.878665 dv-cinder-850321-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 22:23:24.887860 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: spawned uWSGI worker 1 (pid: 120855, cores: 1) Aug 23 22:23:24.887860 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: spawned uWSGI worker 2 (pid: 120856, cores: 1) Aug 23 22:23:24.887860 dv-cinder-850321-4-iscsi devstack@n-api.service[120843]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 22:23:25.584812 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 22:23:25.596908 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 22:23:26.853767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:23:26.853767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: from cryptography.utils import int_from_bytes Aug 23 22:23:26.854530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:23:26.854530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: from cryptography.utils import int_from_bytes Aug 23 22:23:26.905044 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:23:26.905044 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: from cryptography.utils import int_from_bytes Aug 23 22:23:26.906048 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:23:26.906048 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: from cryptography.utils import int_from_bytes Aug 23 22:23:29.614341 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:23:29.615304 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:23:29.615304 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:23:29.615601 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:23:29.616041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:23:29.616226 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.616554 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.616885 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.617270 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.617610 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.617930 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.618279 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.618608 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.618941 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.619237 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.619506 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.619831 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-4-iscsi {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.620241 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.620557 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.620976 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.621359 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.621776 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.622090 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.622418 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.622905 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.624681 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.627588 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.632562 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.634499 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.636092 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.636803 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.638067 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.638825 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.639589 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.641821 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.642979 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-4-iscsi {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.643863 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.644751 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.645338 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.646266 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.646985 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.647693 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.648439 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.649176 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.649938 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.650678 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.651388 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.652425 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.653275 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.653994 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.654706 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.655397 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.656719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.658434 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.659145 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.659733 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.660420 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.661142 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.661743 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.662411 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.662876 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.663346 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.663939 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.664500 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.665124 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.665656 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.666197 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.666736 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.667281 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.667811 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.668457 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.669024 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.669640 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.670195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.670760 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.671340 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.673346 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.674279 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.674744 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.675326 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.675943 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.676521 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.677200 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.677703 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.678288 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.678869 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.679453 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.680035 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.680618 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.681272 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.681842 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.682311 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.682894 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.683478 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.684327 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.684852 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.685441 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.686043 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.686561 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.687112 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.689470 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.690341 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.690931 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.691535 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.692119 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.692762 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.693424 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.694015 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.694627 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.695242 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.695834 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.696411 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.696978 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.697593 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.698193 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.698785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.699364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.699976 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.700559 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.701160 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.701751 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.702318 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.702962 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.705092 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.705665 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.706241 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.707188 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.707786 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.708353 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.708941 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.709531 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.710120 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.710822 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.711280 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.711861 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.712428 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.713035 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.713665 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.714253 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.714815 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.715398 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.715987 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:29.716590 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.717233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.717868 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.718987 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.719628 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.720223 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.720820 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.721409 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.722038 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.722576 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.723267 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.723729 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.724304 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.724913 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.725515 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.726101 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.726689 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.727281 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.727870 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.728440 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.729022 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.729727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.730276 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.730875 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.731515 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.732148 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.732715 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.733557 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.734071 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.735993 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.736666 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.737234 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.737845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.738467 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.739055 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.739660 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.740264 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.740867 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.741519 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.742108 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.742707 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.743342 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.743939 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.744648 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.745174 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.745755 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.746302 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.746897 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.747469 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.748053 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.748618 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.749148 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.750211 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.751660 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.752235 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.752828 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.753454 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.754086 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.754662 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.755257 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.755847 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.756402 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.756939 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.757520 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.758071 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.758635 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.759256 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.759857 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.760449 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.761125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.761684 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.762265 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.762914 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.763476 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.764077 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.764664 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.765990 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.768548 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.769238 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.769842 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.770487 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.771139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.771683 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.772288 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.772902 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.773542 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.774119 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.774705 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.775283 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.775855 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.776437 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.777032 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.777628 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.778188 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.778760 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.779335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.779871 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.780471 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.781603 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.783120 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.783710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.784307 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.784950 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.785546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.786176 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.786791 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.787398 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.787974 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.788550 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.789209 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.789733 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.790312 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.790881 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.791462 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.792071 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.792669 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.793271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.793857 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.794451 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.795046 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.795654 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.796312 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.797436 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.798105 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.798715 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.799309 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.799897 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.800479 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.801224 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.801584 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.802157 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.802727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.803344 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.803891 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.804447 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.805036 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.805645 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.806248 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.806822 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.807429 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.808348 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.809236 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.810262 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.811191 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.811771 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.812404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.813918 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.814490 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.815069 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.815670 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.816270 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.816864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.817486 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.818083 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.818647 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.819210 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.819767 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.820351 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.820927 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.821523 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.822088 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.822678 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.823285 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.823866 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.824434 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.825039 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.825658 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.826234 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.826837 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.827427 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.828524 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.829961 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.830544 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.831207 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.831807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.832387 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.832989 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.833647 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.834221 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.834807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.835395 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.835989 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.836592 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.837207 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.837777 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.838380 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.838981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.839572 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.840174 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.840802 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.841411 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.841988 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.842572 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.843127 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.844383 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.845769 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.848350 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.848350 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.848350 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.848778 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.849003 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.849659 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.850249 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.850859 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.851523 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.852123 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.852685 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.853298 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.853872 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.854452 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.854984 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.855516 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.856080 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.856665 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.857267 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.857841 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.858394 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.858963 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.860988 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.861649 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.862270 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.862864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.863509 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.864114 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.864763 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.865294 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.865845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.866500 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.867083 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.867721 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.868335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.868966 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.869579 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.870175 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.870781 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.871364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.871939 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.873715 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.873715 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.873715 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.876014 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.876014 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.877134 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.877468 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.878059 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.878645 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.879223 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.879791 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.880332 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.880854 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.881444 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.882022 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.882608 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.883185 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.883760 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.884341 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.884916 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.885535 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.886150 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.886585 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.887094 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.887612 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.888128 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.888640 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.889221 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.889785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.891043 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.892484 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.893166 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.893669 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.894235 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.894819 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.895366 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.895905 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.896425 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.896937 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.897470 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.897955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.898485 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.898996 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.899501 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.900058 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.900633 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.901236 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.901803 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.902419 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.902996 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.903565 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.904126 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.904692 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.905374 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.906057 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.907904 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.908422 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.909344 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.909884 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.910406 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.910922 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.911462 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.911968 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.912599 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.913001 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.913544 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.914041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.914539 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.915066 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.915573 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.916089 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.916607 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.917214 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.917823 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.918416 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.918977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.919567 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.920541 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.921154 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.922270 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.923729 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.924323 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.924912 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.925529 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.926114 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.926688 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.927271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.927794 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.928293 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.928844 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.929395 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.929893 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.930418 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.930920 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.931427 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.931916 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.932612 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.933195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.933934 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.934432 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.934939 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.935459 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.935975 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.936508 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.936980 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.939327 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.939938 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.940531 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.941166 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.941743 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.942347 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.942996 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.943538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.944110 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.944678 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.945287 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.945904 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.946453 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.947063 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.947872 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.948445 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.948947 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.949696 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.950192 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.950706 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.951264 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.951856 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.952441 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.954294 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.955054 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.955662 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.956263 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.956883 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.957524 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.958121 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.958675 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.959278 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.959883 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.960475 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.961104 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.961888 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.962487 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.963074 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.963689 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.964298 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.964865 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.965485 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.966073 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.966642 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.967503 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.967792 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.970323 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.970586 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.970983 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.971690 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.972196 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.973542 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.973542 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.974781 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.974781 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.975121 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.975683 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.976281 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.976853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.977495 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.978070 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.978635 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.979195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.979763 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.980388 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.980964 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.981624 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.982223 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.982805 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.983395 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.984012 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.985732 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.986356 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.986947 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.987563 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.988145 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.989460 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.989460 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.989897 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.990464 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.991012 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.991587 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.992161 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.992746 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.993322 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.993912 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.994486 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.995084 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.995639 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.996215 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.996807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.997416 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.998062 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.998622 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:29.999234 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.000965 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.001619 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.002208 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.002811 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.003398 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.003976 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.004566 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.005282 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.005762 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.006342 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.006937 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.007524 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.008094 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.009125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.010089 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.010678 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.011268 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.011850 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.012425 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.013020 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.013636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.014210 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.014774 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.015879 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.017702 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.018090 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.018457 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.018829 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.019241 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.019696 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.020149 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.020518 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.021174 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.021726 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.022083 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.022426 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.022767 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.023100 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.023460 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.023788 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.024122 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.025171 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.025171 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.025171 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.025490 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.025818 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.026169 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.026680 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.027054 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.027385 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.027712 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.028044 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.028646 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.028976 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.029350 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.029678 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.030023 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.030348 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.030679 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.031673 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.031990 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.032310 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.032656 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.032937 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.033280 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.033612 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.034128 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.034740 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.034740 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.034947 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.035524 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.036682 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.036682 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.036682 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.037170 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.037290 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.037534 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.037888 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.038159 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.038477 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.038792 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.039118 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.039491 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.039737 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.040060 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.040368 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.040679 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.040991 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.041337 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.041664 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.041975 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.042289 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.042594 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.042917 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.043228 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.043536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.043839 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.044148 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.044467 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.044778 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.045107 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.045421 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.045739 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.046079 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.046397 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.047249 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.047692 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.048123 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.048708 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.049085 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.049483 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.049820 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.050178 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.050500 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.050980 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.051332 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.051968 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.052311 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.052746 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.053222 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.053638 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.053968 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.054427 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.054738 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.055073 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.055391 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.055707 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.056024 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.056341 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.056656 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.056971 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.057323 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.057639 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.057953 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.058293 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.058863 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.059180 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.059592 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.059911 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.060237 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.060598 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.061022 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.061278 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.061593 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.061915 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.063196 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.063478 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.063986 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.064303 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.064633 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.064968 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.065323 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.065635 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.066067 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.066386 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.066711 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.067042 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.067356 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.067678 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.068132 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.068318 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.069047 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.069047 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.069623 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.069787 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.070025 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.070323 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.070634 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.070951 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.071265 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.071603 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.071904 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.072503 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.072503 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.072801 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.073349 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.073470 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.073747 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.074083 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.074350 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.074667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.074967 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.075273 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.075578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.075883 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.076190 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.076491 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.076808 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.077136 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.077444 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.077747 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.078645 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.079828 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.079828 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.080206 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.080395 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.080724 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.081084 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.081490 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.081811 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.082175 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.082539 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.082867 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.083183 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.083646 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.083971 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.084366 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.084686 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.085004 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.085435 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.085825 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.087095 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.087095 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.087095 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.087554 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.087704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.088023 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.088350 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.088804 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.088999 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.089392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.089754 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.090251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.090619 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.090983 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.091404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.091781 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.092156 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.092499 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.092825 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.094200 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.094200 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.094528 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.094828 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.095456 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.095628 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.095910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.096381 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.096659 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.096983 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.097330 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.097641 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.097891 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:23:30.172208 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO dbcounter [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Registered counter for database nova_api Aug 23 22:23:30.206147 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_db.sqlalchemy.engines [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:23:30.222899 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writer thread running {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:23:30.242706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:23:30.242706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:23:30.242706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:23:30.242706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:23:30.242706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:23:30.242706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.244086 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.244086 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.244086 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.244086 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.244569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.244569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.244817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.245185 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.245443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.245762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.246082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-4-iscsi {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.246401 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.246708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.247077 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.247403 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.247703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.248024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.248438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.249033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.249374 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.249725 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.250064 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.250570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.250887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.251196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.251920 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.251920 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.252239 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.252510 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.252910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-4-iscsi {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.253257 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.253567 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.253879 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.254416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.254726 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.255039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.255442 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.255763 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.256071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.256394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.256708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.257024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.257361 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.257641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.257949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.258416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.258728 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.259084 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.259386 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.259644 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.259931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.260366 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.260613 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.260860 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.261239 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.261534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.261775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.262199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.262483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.262796 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.263076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.263516 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.263761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.263996 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.264276 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.264655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.264979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.265634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.265888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.266136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.266460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.266863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.267109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.267405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.267745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.268059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.268363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.268838 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.269344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.269702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.270017 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.270323 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.270705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.270954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.271255 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.271496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.271793 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.272093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.272523 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.272914 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.273265 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.273506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.273932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.274188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.274421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.274654 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.274972 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.275278 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.275673 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.275983 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.276287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.276592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.276913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.277246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.277546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.277847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.278213 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.278521 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.278929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.279354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.279673 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.279997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.280301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.280623 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.281655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.281983 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.282291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.292343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.292343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.292343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.292343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.292343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.293822 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.294463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.295143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.295769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.296231 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.297524 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.298113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.298666 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.298866 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.context [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c6226fde-aea4-42e2-ab82-e776e5887d31(cell1) {{(pid=120855) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 22:23:30.299270 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.299927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.300982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.301180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.301794 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.302433 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:23:30.303131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.303949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.304123 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:23:30.304617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.304728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:23:30.305395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.306029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.306404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:23:30.306601 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.307172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.307342 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:23:30.307704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:23:30.307896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.308370 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.309209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.309730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.310312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.310874 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.311440 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:23:30.311673 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.312784 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.313466 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.314266 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.314844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.315430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.315998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.316573 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO dbcounter [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Registered counter for database nova_cell0 Aug 23 22:23:30.316738 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.317150 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.317687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.318284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.318887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.319525 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.320052 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.320598 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.321643 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.322053 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.322672 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.323368 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.324092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.324693 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.325301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.325433 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO dbcounter [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Registered counter for database nova_cell1 Aug 23 22:23:30.325893 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.326487 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.327040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.328919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.329757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.330560 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.331424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.332450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.333307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.334112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.334969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.335384 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_db.sqlalchemy.engines [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:23:30.336028 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.336851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.337689 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.337964 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_db.sqlalchemy.engines [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:23:30.338715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.339315 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.339908 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.340771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.341347 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.342195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.343055 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.343887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.344524 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.345116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.345487 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writer thread running {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:23:30.345676 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.346242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.346820 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.346948 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writer thread running {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:23:30.347361 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.348153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.348961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.349576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.350152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.350790 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.351300 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.351957 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.352616 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.353215 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.353813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.354417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.354951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.355522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.356106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.356709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.357309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.357935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.358503 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.359147 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.359716 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.360529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.361195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.362007 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.362787 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.363380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.363952 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.364499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.365038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.365644 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.366204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.366826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.367327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.367867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.368432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.369011 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.369677 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.370224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.370801 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.371303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.371907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.372445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.373339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.373966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.374560 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.375867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.376403 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.376981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.377602 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.378143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.378683 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.379220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.379796 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.380354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.380932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.381536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.383077 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.383077 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.383276 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.383743 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.384309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.384930 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.385541 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.386093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.386664 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.387229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.387810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.388374 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.388925 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.389545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.390116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.391232 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.391756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.392344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.392927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.393541 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.394094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.394678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.395224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.395803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.396439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.397149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.397659 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.398242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.398835 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.399408 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.399990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.400562 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.401155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.401747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.402339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.402960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.403537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.404114 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.404666 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.405306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.406746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.407429 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.408014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.408620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.409269 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.409854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.410456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.411064 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.411625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.412212 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.412827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.413435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.413989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.414538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.415058 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.415656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.416206 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.416821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.417387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.417961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.418526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.419086 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.419637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.420200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.420768 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.421374 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.422574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.423055 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.423615 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.424213 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.424873 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.425500 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.426072 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.426638 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.427197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.427706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.428238 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.428921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.429870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.430451 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.430995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.431556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.432134 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.432702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.433328 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.434192 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.434791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.435373 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.435955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.436535 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.437155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.437746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.438314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.438870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.439432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.439995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.440550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.441136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.441673 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.442354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.442826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.443394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.443945 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.444463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.445026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.445618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.446183 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.446723 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.447275 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.447871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.448430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.449024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.449633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.450256 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.450824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.451402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.451982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.452583 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.453229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.453796 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.454374 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.454930 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.455505 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.456073 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.456779 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.457244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.457812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.458386 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.458891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.459466 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.460062 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.460647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.461254 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.461817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.462422 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.462969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.463531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.464119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.464705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.465303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.465866 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.466423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.466993 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.467583 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.468121 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.469327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.469950 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.470773 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.471334 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.471902 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.472494 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.473047 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.473592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.474126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.474699 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.475253 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.475724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.476285 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.476858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.477479 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.478046 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.478600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.479180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.479759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.480328 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.480900 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.481513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.482146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.482715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.483284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.483864 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.485806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.486021 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.486544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.487159 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.487708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.489112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.489112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.489560 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.489920 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.490443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.490946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.491487 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.492056 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.492648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.493268 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.493841 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.494454 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.495001 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.495600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.496129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.496705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.497329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.497887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.498476 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.499044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.500284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.500973 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.501605 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.502110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.502655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.504100 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.504100 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.504415 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.504870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.505481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.506061 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.507812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.507812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.507812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.508264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.508837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.509357 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.509921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.510474 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.511287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.511832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.512237 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO dbcounter [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Registered counter for database nova_cell0 Aug 23 22:23:30.512432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.512898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.513497 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.514060 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.514725 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.515354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.516959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.517309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.517828 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.518364 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.518922 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.519532 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.520048 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.520593 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.521237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.521399 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_db.sqlalchemy.engines [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:23:30.521786 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.522299 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.522846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.523419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.523953 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.524544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.525371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.525945 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.526511 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writer thread running {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:23:30.526675 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.527282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.527844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.528427 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.529020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.529635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.530210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.530770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.532674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.532674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.533282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.533870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.534460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.535044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.535602 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.536188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.536712 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.537319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.537911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.538701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.539273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.539842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.540415 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.540967 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.541542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.542067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.542611 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.543149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.543690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.544244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.544798 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.545383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.545915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.546452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.547085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.548639 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.548949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.549275 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.549781 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.550329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.550912 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.551476 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.552014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.552577 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.553159 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.553682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.554217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.554751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.555358 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.555876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.556423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.556986 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.557600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.558080 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.558864 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.559381 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.559936 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.560482 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.561089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.561641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.562750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.563523 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.563922 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.564413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.564902 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.565483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.566020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.566556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.567089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.567659 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.568184 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.568741 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.569317 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.569857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.570419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.570959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.571567 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.572059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.572625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.573172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.573697 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.574198 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.574711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.575241 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.575797 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.576350 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.576921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.577513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.578660 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.579233 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.579994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.580366 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.581440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.582002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.582520 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.583061 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.583608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.584182 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.584728 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.585304 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.585894 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.586464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.587024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.587599 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.588193 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.588778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.589432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.590014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.590591 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.591119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.591672 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.592281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.592805 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.594144 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.594724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.595310 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.595880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.596420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.596971 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.597569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.598132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.598709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.599250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.599757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.600249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.600767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.601308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.601818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.603019 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.603019 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.603407 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.604378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.604810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.605425 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.606000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.606578 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.607116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.607549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.608009 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.608450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.608868 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.609859 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.610284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.610697 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.611128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.611557 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.611975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.612406 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.612823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.614026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.614514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.614994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.615756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.616324 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.616651 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.617089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.618306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.618752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.619173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.619599 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.620023 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.620439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.620859 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.621322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.621748 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.622156 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.622572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.623165 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.624076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.624076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.624595 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.627459 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.627459 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.627459 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.627459 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.628260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.628467 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.628941 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.629418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.629978 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.630414 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.630856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.631288 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.631768 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.632194 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.632661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.633211 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.633742 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.634229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.634677 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.635149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.635656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.636127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.636611 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.637083 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.637939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.638412 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.638885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.639431 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.639888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.640458 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.640956 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.641455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.641971 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.642419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.642866 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.643369 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.643808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.644264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.644708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.645238 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.645681 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.646129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.646757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.647115 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.647625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.648130 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.648570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.649014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.649611 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.650063 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.650519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.650970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.651421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.651861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.652307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.652745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.653236 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.653685 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.654162 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.654605 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.655046 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.655608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.656199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.656683 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.657254 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.657763 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.658284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.658716 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.659140 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.659584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.660001 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.660354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.660710 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.661192 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.661663 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.662172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.662687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.663216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.663754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.664274 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.664775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.665318 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.665705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.666031 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.666349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.666885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.667852 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.667852 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.668202 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.668706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.669161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.669581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.670120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.670556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.671036 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.671471 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.672423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.672979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.673498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.675030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.675030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.675502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.675708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.676145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.676597 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.677081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.677532 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.678053 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.678488 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.678939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.679472 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.679929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.680482 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.681518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.681518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.682004 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.682456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.682909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.683351 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.684056 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.684500 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.684953 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.685420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.689298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.689298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.689298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.689298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.689298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.689298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.690725 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.691208 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.691674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.692142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.692617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.693167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.693634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.694132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.694584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.695024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.695468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.695898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.696329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.696764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.697422 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.697836 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.698255 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.698650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.699033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.699420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.699802 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:23:30.701434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:23:30.787531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO dbcounter [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Registered counter for database nova_api Aug 23 22:23:30.816230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:23:30.830685 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writer thread running {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:23:30.925667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: WARNING keystonemiddleware.auth_token [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:23:30.933369 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: WARNING keystonemiddleware.auth_token [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:23:30.949431 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.context [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c6226fde-aea4-42e2-ab82-e776e5887d31(cell1) {{(pid=120856) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 22:23:30.957653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:23:30.958507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:23:30.962713 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:23:30.963363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:23:30.964186 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:23:30.969113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:23:30.972765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO dbcounter [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Registered counter for database nova_cell0 Aug 23 22:23:30.982029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO dbcounter [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Registered counter for database nova_cell1 Aug 23 22:23:30.995281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:23:30.997541 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:23:31.008097 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writer thread running {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:23:31.008490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writer thread running {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:23:31.310284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO dbcounter [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Registered counter for database nova_cell0 Aug 23 22:23:31.322258 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:23:31.330325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writer thread running {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:23:31.385270 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: WARNING keystonemiddleware.auth_token [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:23:31.391977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: WARNING keystonemiddleware.auth_token [None req-460f3004-f8f4-4d3e-967c-bb700c9a31a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:23:31.397762 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bc1a4f49c0 pid: 120855 (default app) Aug 23 22:23:31.662389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: WARNING keystonemiddleware.auth_token [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:23:31.669900 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: WARNING keystonemiddleware.auth_token [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:23:32.028836 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: WARNING keystonemiddleware.auth_token [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 22:23:32.035610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: WARNING keystonemiddleware.auth_token [None req-ed1aac0e-1cb0-487b-9817-a5f3fd04a3f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 22:23:32.041047 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55bc1a4f49c0 pid: 120856 (default app) Aug 23 22:24:15.898077 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=3 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:15.900303 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=3 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:15.901371 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=3 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:15.902137 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=3 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:18.062301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=3 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:18.070832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=3 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:18.072311 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=3 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:18.073577 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=3 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:18.894538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-02b4d8a5-ef9e-44fb-afac-79238b5d808c tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Action: 'create', calling method: .version_select at 0x7f902e1015e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1520700864"}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:19.675229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8d309ff5-aa35-4175-a4fd-42bb6110e7cb tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Action: 'create', calling method: .version_select at 0x7f902e1025e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2017312726", "metadata": {"Type": "work"}}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8d309ff5-aa35-4175-a4fd-42bb6110e7cb tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Request method failure captured: Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 122 Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVORSQ-iQKDJebWWGgF0BizMBykmjpuhUX2lUfeBPFE2kQY5idqIZeM32sz_nURnaqqiQuYZU9U2PT9XlC_lCgMamR6NgG9hLqQX-hiZ26RttVW-m38VJ7T3n-23_5xLi5lx_BAcsJdqjuILPQBYPFRdx1Fn2nnd-lsSxiaooML1R20 Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:24:19.694547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}] Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: bc1090fafe494c159d0d24790b23b018 Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2017312726", "metadata": {"Type": "work"}}} Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: Aug 23 22:24:19.697848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2017312726', 'metadata': {'Type': 'work'}}}} Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise error Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi '#$%' Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:19.700152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 22:24:19.704923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 22:24:19.712022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 22:24:19.712022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.712022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8d309ff5-aa35-4175-a4fd-42bb6110e7cb tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:19.712022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8d309ff5-aa35-4175-a4fd-42bb6110e7cb tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.641468 Aug 23 22:24:19.712022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 1/1] 10.222.0.88 () {60 vars in 1156 bytes} [Tue Aug 23 22:24:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1652 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:24:19.735561 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fbe1220f-8cc6-42a0-8f12-8f1bbe644708 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Action: 'create', calling method: .version_select at 0x7f902e102670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1858005158", "metadata": {"Type": "work"}}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fbe1220f-8cc6-42a0-8f12-8f1bbe644708 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Request method failure captured: Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 120 Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVORSQ-iQKDJebWWGgF0BizMBykmjpuhUX2lUfeBPFE2kQY5idqIZeM32sz_nURnaqqiQuYZU9U2PT9XlC_lCgMamR6NgG9hLqQX-hiZ26RttVW-m38VJ7T3n-23_5xLi5lx_BAcsJdqjuILPQBYPFRdx1Fn2nnd-lsSxiaooML1R20 Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:24:19.753143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}] Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: bc1090fafe494c159d0d24790b23b018 Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1858005158", "metadata": {"Type": "work"}}} Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: Aug 23 22:24:19.754684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1858005158', 'metadata': {'Type': 'work'}}}} Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise error Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi '0' Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:19.755462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 22:24:19.756799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 22:24:19.759753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 22:24:19.759753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.759753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fbe1220f-8cc6-42a0-8f12-8f1bbe644708 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:19.759753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fbe1220f-8cc6-42a0-8f12-8f1bbe644708 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.049592 Aug 23 22:24:19.769497 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 2/2] 10.222.0.88 () {60 vars in 1156 bytes} [Tue Aug 23 22:24:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:24:19.795877 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ecfe503c-825b-4520-b1c8-8f5d52dd16dc tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Action: 'create', calling method: .version_select at 0x7f902e0391f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-519428964", "metadata": {"Type": "work"}}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ecfe503c-825b-4520-b1c8-8f5d52dd16dc tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Request method failure captured: Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 118 Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVORSQ-iQKDJebWWGgF0BizMBykmjpuhUX2lUfeBPFE2kQY5idqIZeM32sz_nURnaqqiQuYZU9U2PT9XlC_lCgMamR6NgG9hLqQX-hiZ26RttVW-m38VJ7T3n-23_5xLi5lx_BAcsJdqjuILPQBYPFRdx1Fn2nnd-lsSxiaooML1R20 Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:24:19.822809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}] Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: bc1090fafe494c159d0d24790b23b018 Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-519428964", "metadata": {"Type": "work"}}} Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: Aug 23 22:24:19.824291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-519428964', 'metadata': {'Type': 'work'}}}} Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise error Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi '' Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:19.825273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 22:24:19.826833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 22:24:19.827947 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 22:24:19.827947 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:19.832921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ecfe503c-825b-4520-b1c8-8f5d52dd16dc tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:19.833305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ecfe503c-825b-4520-b1c8-8f5d52dd16dc tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.062943 Aug 23 22:24:19.850214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 3/3] 10.222.0.88 () {60 vars in 1156 bytes} [Tue Aug 23 22:24:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:24:19.880410 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-79c77145-3f94-4b89-9288-a715914f883b tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Calling method '.version_select at 0x7f902e039b80>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:20.877910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-79c77145-3f94-4b89-9288-a715914f883b tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] HTTP exception thrown: Volume tempest-invalid-590049039 could not be found. Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-79c77145-3f94-4b89-9288-a715914f883b tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Request method failure captured: Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-590049039 HTTP/1.1 Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVORSQ-iQKDJebWWGgF0BizMBykmjpuhUX2lUfeBPFE2kQY5idqIZeM32sz_nURnaqqiQuYZU9U2PT9XlC_lCgMamR6NgG9hLqQX-hiZ26RttVW-m38VJ7T3n-23_5xLi5lx_BAcsJdqjuILPQBYPFRdx1Fn2nnd-lsSxiaooML1R20 Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:24:20.891456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}] Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: bc1090fafe494c159d0d24790b23b018 Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Volume tempest-invalid-590049039 could not be found. Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'tempest-invalid-590049039'} Aug 23 22:24:20.893237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-590049039 could not be found. (HTTP 404) (Request-ID: req-173424ab-9b38-4b7a-9635-ab58832ae3bf) Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:20.894119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:24:20.895440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-590049039 could not be found. Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:20.896825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-590049039 could not be found. Aug 23 22:24:20.901507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:20.901507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:20.901507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:20.901507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:20.901507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:20.901507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:20.901507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:20.901507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:20.901507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-590049039 could not be found. Aug 23 22:24:20.901507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:20.904399 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-79c77145-3f94-4b89-9288-a715914f883b tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Returning 404 to user: Volume tempest-invalid-590049039 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:20.912548 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-79c77145-3f94-4b89-9288-a715914f883b tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/tempest-invalid-590049039" status: 404 len: 98 microversion: 2.1 time: 1.054262 Aug 23 22:24:20.916490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 4/4] 10.222.0.88 () {58 vars in 1215 bytes} [Tue Aug 23 22:24:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-590049039 => generated 98 bytes in 1066 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 22:24:20.966904 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4bf132d2-2710-4ce1-9192-2ae20b69c57b tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.039284 Aug 23 22:24:20.971045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 5/5] 10.222.0.88 () {58 vars in 1140 bytes} [Tue Aug 23 22:24:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 23 22:24:20.991944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ce13c8c9-fc37-4814-a708-09197344f8df tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012226 Aug 23 22:24:20.994161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 6/6] 10.222.0.88 () {58 vars in 1137 bytes} [Tue Aug 23 22:24:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 22:24:21.023906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-518fd84e-0c53-4d92-a017-3ee9c288fa82 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Calling method '.version_select at 0x7f902df6e550>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:21.288333 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-518fd84e-0c53-4d92-a017-3ee9c288fa82 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] HTTP exception thrown: Volume 28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d could not be found. Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-518fd84e-0c53-4d92-a017-3ee9c288fa82 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Request method failure captured: Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/os-volumes/28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d HTTP/1.1 Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVORSQ-iQKDJebWWGgF0BizMBykmjpuhUX2lUfeBPFE2kQY5idqIZeM32sz_nURnaqqiQuYZU9U2PT9XlC_lCgMamR6NgG9hLqQX-hiZ26RttVW-m38VJ7T3n-23_5xLi5lx_BAcsJdqjuILPQBYPFRdx1Fn2nnd-lsSxiaooML1R20 Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:24:21.295581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}] Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: bc1090fafe494c159d0d24790b23b018 Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Volume 28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d could not be found. Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d'} Aug 23 22:24:21.298395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d could not be found. (HTTP 404) (Request-ID: req-70d299a9-d041-4627-aa8d-d02691b7a8cf) Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:21.299847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:24:21.301942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d could not be found. Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 22:24:21.303886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d could not be found. Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d could not be found. Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.309687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-518fd84e-0c53-4d92-a017-3ee9c288fa82 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Returning 404 to user: Volume 28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:21.318513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-518fd84e-0c53-4d92-a017-3ee9c288fa82 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d" status: 404 len: 109 microversion: 2.1 time: 0.307403 Aug 23 22:24:21.325747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 7/7] 10.222.0.88 () {58 vars in 1248 bytes} [Tue Aug 23 22:24:20 2022] DELETE /compute/v2.1/os-volumes/28ff4384-b1e3-401b-ae10-3cfbc0d3dc5d => generated 109 bytes in 326 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:24:21.347754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-25621e4a-e5d1-4e57-a7c1-8ba930ace380 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Calling method '.version_select at 0x7f902df6e430>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:21.382422 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-02b4d8a5-ef9e-44fb-afac-79238b5d808c tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 5.495212 Aug 23 22:24:21.386756 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 1/8] 10.222.0.88 () {60 vars in 1155 bytes} [Tue Aug 23 22:24:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 5502 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 22:24:21.412177 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8cdc9b1c-e556-4453-8ba8-c5ce537506db tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902dfd64c0>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:21.452040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-25621e4a-e5d1-4e57-a7c1-8ba930ace380 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] HTTP exception thrown: Volume ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0 could not be found. Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-25621e4a-e5d1-4e57-a7c1-8ba930ace380 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Request method failure captured: Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/os-volumes/ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0 HTTP/1.1 Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVORSQ-iQKDJebWWGgF0BizMBykmjpuhUX2lUfeBPFE2kQY5idqIZeM32sz_nURnaqqiQuYZU9U2PT9XlC_lCgMamR6NgG9hLqQX-hiZ26RttVW-m38VJ7T3n-23_5xLi5lx_BAcsJdqjuILPQBYPFRdx1Fn2nnd-lsSxiaooML1R20 Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:24:21.456727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ab26978fb927482ba0da326c3aa6cbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ab26978fb927482ba0da326c3aa6cbba"}]}] Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: ab26978fb927482ba0da326c3aa6cbba Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesNegativeTest-261271612 Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: bc1090fafe494c159d0d24790b23b018 Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesNegativeTest-261271612-project Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Volume ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0 could not be found. Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0'} Aug 23 22:24:21.458325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0 could not be found. (HTTP 404) (Request-ID: req-0d464207-2c7f-4194-a3b4-1589646f6d9b) Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:21.459128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:24:21.460221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0 could not be found. Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 22:24:21.461378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0 could not be found. Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0 could not be found. Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:21.462356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-25621e4a-e5d1-4e57-a7c1-8ba930ace380 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] Returning 404 to user: Volume ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:21.463007 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-25621e4a-e5d1-4e57-a7c1-8ba930ace380 tempest-VolumesNegativeTest-261271612 tempest-VolumesNegativeTest-261271612-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0" status: 404 len: 109 microversion: 2.1 time: 0.128234 Aug 23 22:24:21.474938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 8/9] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:24:21 2022] GET /compute/v2.1/os-volumes/ad19be4d-2c6c-47e2-8591-5d68b5ed2ef0 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:24:21.629821 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8cdc9b1c-e556-4453-8ba8-c5ce537506db tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb" status: 200 len: 345 microversion: 2.1 time: 0.226685 Aug 23 22:24:21.644473 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 2/10] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:24:21 2022] GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb => generated 345 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:22.658805 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-dbdca8ed-1cf3-43e0-9a91-51467fd7ab2f tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902e039dc0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:22.875640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-dbdca8ed-1cf3-43e0-9a91-51467fd7ab2f tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb" status: 200 len: 346 microversion: 2.1 time: 0.225574 Aug 23 22:24:22.877039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 9/11] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:24:22 2022] GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb => generated 346 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:22.916106 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-38721d31-592a-4cb8-b53b-f0d8761983f6 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Action: 'create', calling method: .version_select at 0x7f902dfd6af0>, body: {"snapshot": {"volume_id": "4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1259476200"}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:23.618895 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-38721d31-592a-4cb8-b53b-f0d8761983f6 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.716018 Aug 23 22:24:23.619700 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 3/12] 10.222.0.88 () {60 vars in 1162 bytes} [Tue Aug 23 22:24:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:23.632434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-93b5998a-54f8-4a73-b6fc-9e219d1f02a9 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902df6edc0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:23.837875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-93b5998a-54f8-4a73-b6fc-9e219d1f02a9 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3" status: 200 len: 287 microversion: 2.1 time: 0.209472 Aug 23 22:24:23.839392 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 10/13] 10.222.0.88 () {58 vars in 1251 bytes} [Tue Aug 23 22:24:23 2022] GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3 => generated 287 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:24:23.852646 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ba0ee349-3d4d-40bb-aa36-a58d076db940 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902dfedca0>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:23.919506 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ba0ee349-3d4d-40bb-aa36-a58d076db940 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.068587 Aug 23 22:24:23.921454 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 4/14] 10.222.0.88 () {58 vars in 1140 bytes} [Tue Aug 23 22:24:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:23.938734 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b587b9d9-8c38-487a-8c5c-ce74b0917f08 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902df6ee50>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:24.041381 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b587b9d9-8c38-487a-8c5c-ce74b0917f08 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3" status: 200 len: 287 microversion: 2.1 time: 0.109731 Aug 23 22:24:24.072612 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 11/15] 10.222.0.88 () {58 vars in 1251 bytes} [Tue Aug 23 22:24:23 2022] GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3 => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:25.069833 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8cd6b2b9-8512-4e4f-b432-255aacea9331 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902e101ee0>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:25.135759 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8cd6b2b9-8512-4e4f-b432-255aacea9331 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3" status: 200 len: 287 microversion: 2.1 time: 0.068496 Aug 23 22:24:25.157505 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 5/16] 10.222.0.88 () {58 vars in 1251 bytes} [Tue Aug 23 22:24:25 2022] GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:26.166940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3eafd30e-f607-4f3a-94b1-75b4bc00eb3e tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902df754c0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:26.311164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3eafd30e-f607-4f3a-94b1-75b4bc00eb3e tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3" status: 200 len: 287 microversion: 2.1 time: 0.149907 Aug 23 22:24:26.318170 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 12/17] 10.222.0.88 () {58 vars in 1251 bytes} [Tue Aug 23 22:24:26 2022] GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3 => generated 287 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:24:27.332299 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-12cd3388-8a83-42cd-a9e9-63d7a34c56f3 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902dfd69d0>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:27.415061 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-12cd3388-8a83-42cd-a9e9-63d7a34c56f3 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3" status: 200 len: 288 microversion: 2.1 time: 0.092412 Aug 23 22:24:27.429359 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 6/18] 10.222.0.88 () {58 vars in 1251 bytes} [Tue Aug 23 22:24:27 2022] GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3 => generated 288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:27.429663 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6d5ca865-f625-4f61-a26f-7e1f273b77bf tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902df6e0d0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:27.675287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6d5ca865-f625-4f61-a26f-7e1f273b77bf tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "DELETE /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3" status: 202 len: 0 microversion: 2.1 time: 0.250656 Aug 23 22:24:27.687498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 13/19] 10.222.0.88 () {58 vars in 1254 bytes} [Tue Aug 23 22:24:27 2022] DELETE /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:24:27.692543 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7c107633-0425-453d-ada9-16abe37c2d3c tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902dfd6280>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:27.783502 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7c107633-0425-453d-ada9-16abe37c2d3c tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3" status: 200 len: 287 microversion: 2.1 time: 0.099154 Aug 23 22:24:27.804890 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 7/20] 10.222.0.88 () {58 vars in 1251 bytes} [Tue Aug 23 22:24:27 2022] GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:28.802732 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1649e83b-d639-4de3-b949-c4991759de96 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902dfbdca0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:28.886383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-1649e83b-d639-4de3-b949-c4991759de96 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] HTTP exception thrown: Snapshot 9e0ddeee-104c-4f3b-af0b-bff455beb9b3 could not be found. Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1649e83b-d639-4de3-b949-c4991759de96 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Request method failure captured: Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3 HTTP/1.1 Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOPbeAIK-nc_YIu_OQI_OQ76Ayq1R_J6F5mfUuEUDuVNxjHZVBm_Xxs7gnKABJWPd8XKmJnD_TGtXE4iA2f_50e8n6SRNPdmmsalrWdaO8rh_Jl75145uYr-OOwqEdN3ASgXXbm-bUCzVikjuEgBGByk07sGfYWlwiUDvfr6f3wQSU Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: a5eed99762724bc69ca69883429093fc Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:24:28.889735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5eed99762724bc69ca69883429093fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a5eed99762724bc69ca69883429093fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a5eed99762724bc69ca69883429093fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5eed99762724bc69ca69883429093fc"}]}] Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: a5eed99762724bc69ca69883429093fc Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesSnapshotsTestJSON-1272391833-project Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: e597a0bc1dd74a11be334d7e1cb18446 Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1272391833-project Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Snapshot 9e0ddeee-104c-4f3b-af0b-bff455beb9b3 could not be found. Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '9e0ddeee-104c-4f3b-af0b-bff455beb9b3'} Aug 23 22:24:28.890885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9e0ddeee-104c-4f3b-af0b-bff455beb9b3 could not be found. (HTTP 404) (Request-ID: req-d48e7b6b-41fc-4f97-ba51-112c8850ce60) Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:28.891544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:24:28.892504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9e0ddeee-104c-4f3b-af0b-bff455beb9b3 could not be found. Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 23 22:24:28.895413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9e0ddeee-104c-4f3b-af0b-bff455beb9b3 could not be found. Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9e0ddeee-104c-4f3b-af0b-bff455beb9b3 could not be found. Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1649e83b-d639-4de3-b949-c4991759de96 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Returning 404 to user: Snapshot 9e0ddeee-104c-4f3b-af0b-bff455beb9b3 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:28.898033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1649e83b-d639-4de3-b949-c4991759de96 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3" status: 404 len: 111 microversion: 2.1 time: 0.093558 Aug 23 22:24:28.901250 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bf6c8d71-98b5-427e-baf1-a55ccfa242c1 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902dfd6a60>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:28.906771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 14/21] 10.222.0.88 () {58 vars in 1251 bytes} [Tue Aug 23 22:24:28 2022] GET /compute/v2.1/os-snapshots/9e0ddeee-104c-4f3b-af0b-bff455beb9b3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:24:29.370468 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-bf6c8d71-98b5-427e-baf1-a55ccfa242c1 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb" status: 202 len: 0 microversion: 2.1 time: 0.472501 Aug 23 22:24:29.381346 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 8/22] 10.222.0.88 () {58 vars in 1248 bytes} [Tue Aug 23 22:24:28 2022] DELETE /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:24:29.381802 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0f6d5721-b0ce-456b-a4a6-7f1d78322f9a tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902dfbd9d0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:29.571097 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0f6d5721-b0ce-456b-a4a6-7f1d78322f9a tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb" status: 200 len: 345 microversion: 2.1 time: 0.194329 Aug 23 22:24:29.572039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 15/23] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:24:29 2022] GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb => generated 345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:30.593816 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-177642a1-656c-42b1-bd29-ebd2d1214c44 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902e9ac8b0>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:30.702655 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.wsgi [None req-177642a1-656c-42b1-bd29-ebd2d1214c44 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] HTTP exception thrown: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-177642a1-656c-42b1-bd29-ebd2d1214c44 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Request method failure captured: Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: request: GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb HTTP/1.1 Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept: application/json Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept-Encoding: identity Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Connection: close Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Length: 0 Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Type: application/json Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Host: 10.222.0.88 Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Openstack-System-Scope: None Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: User-Agent: python-urllib3/1.26.11 Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Auth-Token: gAAAAABjBVOPbeAIK-nc_YIu_OQI_OQ76Ayq1R_J6F5mfUuEUDuVNxjHZVBm_Xxs7gnKABJWPd8XKmJnD_TGtXE4iA2f_50e8n6SRNPdmmsalrWdaO8rh_Jl75145uYr-OOwqEdN3ASgXXbm-bUCzVikjuEgBGByk07sGfYWlwiUDvfr6f3wQSU Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Id: None Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Name: None Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Identity-Status: Confirmed Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Is-Admin-Project: True Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Id: default Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Name: Default Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Id: a5eed99762724bc69ca69883429093fc Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Role: member,reader Aug 23 22:24:30.709845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Roles: member,reader Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5eed99762724bc69ca69883429093fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a5eed99762724bc69ca69883429093fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a5eed99762724bc69ca69883429093fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5eed99762724bc69ca69883429093fc"}]}] Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Id: a5eed99762724bc69ca69883429093fc Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User: tempest-VolumesSnapshotsTestJSON-1272391833-project Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Id: default Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Name: Default Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Id: e597a0bc1dd74a11be334d7e1cb18446 Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1272391833-project Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: method: Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: exception: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: action_args: {'id': '4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb'} Aug 23 22:24:30.711233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. (HTTP 404) (Request-ID: req-158f1a22-57cc-4791-9480-88e93c914b90) Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:30.711946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:24:30.714251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 22:24:30.716538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:30.718546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:30.722049 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-177642a1-656c-42b1-bd29-ebd2d1214c44 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Returning 404 to user: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. {{(pid=120855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:30.723323 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-177642a1-656c-42b1-bd29-ebd2d1214c44 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb" status: 404 len: 109 microversion: 2.1 time: 0.138363 Aug 23 22:24:30.727515 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 9/24] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:24:30 2022] GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:24:30.761697 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-288a82a4-c982-4637-a1f9-694e6c5ede05 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902df6e940>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:31.019975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-288a82a4-c982-4637-a1f9-694e6c5ede05 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] HTTP exception thrown: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-288a82a4-c982-4637-a1f9-694e6c5ede05 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Request method failure captured: Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb HTTP/1.1 Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOPbeAIK-nc_YIu_OQI_OQ76Ayq1R_J6F5mfUuEUDuVNxjHZVBm_Xxs7gnKABJWPd8XKmJnD_TGtXE4iA2f_50e8n6SRNPdmmsalrWdaO8rh_Jl75145uYr-OOwqEdN3ASgXXbm-bUCzVikjuEgBGByk07sGfYWlwiUDvfr6f3wQSU Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: a5eed99762724bc69ca69883429093fc Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:24:31.022067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5eed99762724bc69ca69883429093fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a5eed99762724bc69ca69883429093fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a5eed99762724bc69ca69883429093fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5eed99762724bc69ca69883429093fc"}]}] Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: a5eed99762724bc69ca69883429093fc Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesSnapshotsTestJSON-1272391833-project Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: e597a0bc1dd74a11be334d7e1cb18446 Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1272391833-project Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb'} Aug 23 22:24:31.024404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. (HTTP 404) (Request-ID: req-6fb82f23-cf39-44df-8cff-ed19f4d3634b) Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:31.025961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 22:24:31.027931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 22:24:31.035995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-288a82a4-c982-4637-a1f9-694e6c5ede05 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Returning 404 to user: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-288a82a4-c982-4637-a1f9-694e6c5ede05 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb" status: 404 len: 109 microversion: 2.1 time: 0.273622 Aug 23 22:24:31.038126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 16/25] 10.222.0.88 () {58 vars in 1248 bytes} [Tue Aug 23 22:24:30 2022] DELETE /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb => generated 109 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:24:31.047775 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b3d66662-cae5-47cf-a1fd-aaf44c202082 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Calling method '.version_select at 0x7f902dff38b0>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:31.111365 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.wsgi [None req-b3d66662-cae5-47cf-a1fd-aaf44c202082 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] HTTP exception thrown: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b3d66662-cae5-47cf-a1fd-aaf44c202082 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Request method failure captured: Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: request: GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb HTTP/1.1 Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept: application/json Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept-Encoding: identity Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Connection: close Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Length: 0 Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Type: application/json Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Host: 10.222.0.88 Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Openstack-System-Scope: None Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: User-Agent: python-urllib3/1.26.11 Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Auth-Token: gAAAAABjBVOPbeAIK-nc_YIu_OQI_OQ76Ayq1R_J6F5mfUuEUDuVNxjHZVBm_Xxs7gnKABJWPd8XKmJnD_TGtXE4iA2f_50e8n6SRNPdmmsalrWdaO8rh_Jl75145uYr-OOwqEdN3ASgXXbm-bUCzVikjuEgBGByk07sGfYWlwiUDvfr6f3wQSU Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Id: None Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Name: None Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Identity-Status: Confirmed Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Is-Admin-Project: True Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Id: default Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Name: Default Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Id: a5eed99762724bc69ca69883429093fc Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Role: member,reader Aug 23 22:24:31.113710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Roles: member,reader Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5eed99762724bc69ca69883429093fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a5eed99762724bc69ca69883429093fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a5eed99762724bc69ca69883429093fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a5eed99762724bc69ca69883429093fc"}]}] Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Id: a5eed99762724bc69ca69883429093fc Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1272391833 Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User: tempest-VolumesSnapshotsTestJSON-1272391833-project Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Id: default Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Name: Default Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Id: e597a0bc1dd74a11be334d7e1cb18446 Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1272391833-project Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: method: Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: exception: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: action_args: {'id': '4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb'} Aug 23 22:24:31.114981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. (HTTP 404) (Request-ID: req-f2e88395-85b5-4f51-b347-5bb1ce2acf1d) Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:31.115704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:24:31.116667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 22:24:31.117719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b3d66662-cae5-47cf-a1fd-aaf44c202082 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] Returning 404 to user: Volume 4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb could not be found. {{(pid=120855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:24:31.118644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-b3d66662-cae5-47cf-a1fd-aaf44c202082 tempest-VolumesSnapshotsTestJSON-1272391833 tempest-VolumesSnapshotsTestJSON-1272391833-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb" status: 404 len: 109 microversion: 2.1 time: 0.085913 Aug 23 22:24:31.120122 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 10/26] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:24:31 2022] GET /compute/v2.1/os-volumes/4dcda2a3-39b2-4b11-bb23-8e1d7c75aafb => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:24:34.178030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-dfd38697-16b5-45cd-9105-c674cbe9d9cf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Action: 'create', calling method: .version_select at 0x7f902df751f0>, body: {"keypair": {"name": "tempest-keypair-1424048073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6xtnekM9bYPKF8W61+C0npO8pxh+XeCod+PBG2XJVUe8e0SIqhTI3384HFsN/fFiyS2NAkMEwbYvVs0bZ+CHUXA6db1Pambls/y9uJP3p/ujhiqhas9z2mf7Jp+q4nXQ=="}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:34.339861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-dfd38697-16b5-45cd-9105-c674cbe9d9cf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Getting quotas for project 8be30316f0b745d783ec96bc983b2cb1. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:24:34.363759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-dfd38697-16b5-45cd-9105-c674cbe9d9cf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Getting quotas for user c06cd43d533f4621b0a69dbb0ef22dc4 and project 8be30316f0b745d783ec96bc983b2cb1. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:24:34.508979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-dfd38697-16b5-45cd-9105-c674cbe9d9cf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.187844 Aug 23 22:24:34.511880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 17/27] 10.222.0.88 () {62 vars in 1200 bytes} [Tue Aug 23 22:24:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1192 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 22:24:41.535634 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5d6daf5e-2556-4fba-be9e-0100205f1690 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: .version_select at 0x7f902dff3700>, body: {"keypair": {"name": "tempest-keypair-928307855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtSP5PBpT3VlYQZRXlRmsUvNDtvo1MYCGE9kpoP3cpQ4rp9GLpRlVZ023T4UKAX85/KwGVlXQlGKucd5n29VkS7k1uUyXq+YF6Z4aqCpjKsJEnbyB9j3NcOOsFxAcL4GQ=="}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:41.655204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1a5d355f-9c60-4fbf-b312-1b13c87c136c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'create', calling method: .version_select at 0x7f902decdaf0>, body: {"keypair": {"name": "tempest-keypair-547123866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqVbBAnXTnhBWfHWJ4kq1xXznsYKwZ2kPPBEBXAsiB3vuUMv2XAPgQKJH5P7gmyQKF7hR4yD9IXQG0PneIKq4Fgu+4wssLWGGbZhCy+Nrai+gDX6/Ts4UiicToiO7QewA=="}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:41.777371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-1a5d355f-9c60-4fbf-b312-1b13c87c136c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Getting quotas for project a297ef598b76404b86e9350e120b86c9. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:24:41.790676 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-1a5d355f-9c60-4fbf-b312-1b13c87c136c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Getting quotas for user e720fd25d54b4dc6b3387ea762d7e4ae and project a297ef598b76404b86e9350e120b86c9. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:24:41.794229 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-5d6daf5e-2556-4fba-be9e-0100205f1690 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for project c0fc1c15f821495e9883814ffc7aed78. Resources: {'key_pairs'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:24:41.816909 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-5d6daf5e-2556-4fba-be9e-0100205f1690 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for user 1db1a9a77be6452991ec4f99af814e7a and project c0fc1c15f821495e9883814ffc7aed78. Resources: {'key_pairs'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:24:41.928854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1a5d355f-9c60-4fbf-b312-1b13c87c136c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.559988 Aug 23 22:24:41.944271 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 18/28] 10.222.0.88 () {60 vars in 1159 bytes} [Tue Aug 23 22:24:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:41.990928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5d6daf5e-2556-4fba-be9e-0100205f1690 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.046051 Aug 23 22:24:41.992928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 11/29] 10.222.0.88 () {60 vars in 1159 bytes} [Tue Aug 23 22:24:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:24:47.887875 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-675532698", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88a201d9-4618-46e2-8cf5-795d8dfe4e5c"}], "security_groups": [{"name": "tempest-securitygroup--1256498956"}], "key_name": "tempest-keypair-1424048073", "user_data": "}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:48.576777 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-526374869", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:48.992890 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.network.neutron [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] validate_networks() for [('88a201d9-4618-46e2-8cf5-795d8dfe4e5c', None, None, None, None, None)] {{(pid=120855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:24:49.096866 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] validate_networks() for [('6d954100-70c0-4f0f-a697-9d74a7a12bf8', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:24:51.839174 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=8 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:51.862774 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=4 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:52.652602 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:24:52.654863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:24:52.656177 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:24:52.657913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:24:52.658629 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:24:52.677200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:52.680038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:52.680802 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:52.682080 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:52.683045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:52.684695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:52.719722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Getting quotas for project 1dfc84dc05d542d987194096f3b7e51a. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:24:52.734781 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Getting quotas for user 78b05a538ce0466ea8b3e27a0a6fc162 and project 1dfc84dc05d542d987194096f3b7e51a. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:24:52.759573 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:24:52.763498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:24:52.824726 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Flavor limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:24:52.825358 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Image limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:24:52.827397 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Flavor pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:24:52.828118 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Image pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:24:52.828700 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:24:52.854984 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:52.855488 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:52.855936 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:52.864227 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:52.865406 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:52.867843 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:52.934055 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Getting quotas for project 8be30316f0b745d783ec96bc983b2cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:24:52.949798 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Getting quotas for user c06cd43d533f4621b0a69dbb0ef22dc4 and project 8be30316f0b745d783ec96bc983b2cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:24:52.997765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-91333f32-0b37-46c9-8476-ca80285d3d6c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.180789 Aug 23 22:24:52.999367 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 19/30] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:24:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 5183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:24:53.045513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1149288276", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b506c549-1d3c-4779-b5de-b5a4c62df2b1"}], "security_groups": [{"name": "tempest-securitygroup--243111476"}], "key_name": "tempest-keypair-547123866", "user_data": "}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:53.049047 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Going to run 1 instances... {{(pid=120855) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:24:53.059265 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:24:53.331799 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-439471db-9cc0-4777-8589-e4064a03a7b4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.448763 Aug 23 22:24:53.336994 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 12/31] 10.222.0.88 () {62 vars in 1188 bytes} [Tue Aug 23 22:24:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 5454 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 23 22:24:53.358964 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1900613935", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c01e5e5-25ba-44de-af70-328d6d292257"}], "security_groups": [{"name": "tempest-securitygroup--333017219"}], "key_name": "tempest-keypair-928307855", "user_data": "}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:53.611354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] validate_networks() for [('b506c549-1d3c-4779-b5de-b5a4c62df2b1', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:24:53.807524 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.network.neutron [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] validate_networks() for [('4c01e5e5-25ba-44de-af70-328d6d292257', None, None, None, None, None)] {{(pid=120855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:24:55.127895 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Flavor limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:24:55.128540 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Image limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:24:55.129243 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Flavor pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:24:55.130102 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Image pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:24:55.131161 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:24:55.176839 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:55.179058 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:55.179976 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:55.188342 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:55.189310 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:55.190433 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:55.244509 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for project c0fc1c15f821495e9883814ffc7aed78. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:24:55.252894 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for user 1db1a9a77be6452991ec4f99af814e7a and project c0fc1c15f821495e9883814ffc7aed78. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:24:55.314313 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Going to run 1 instances... {{(pid=120855) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:24:55.333939 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:24:55.351690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:24:55.352424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:24:55.353468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:24:55.354153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:24:55.354846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:24:55.396001 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:55.396797 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:55.397559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:55.398851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:55.399625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:55.400331 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:55.568930 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Getting quotas for project a297ef598b76404b86e9350e120b86c9. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:24:55.607477 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Getting quotas for user e720fd25d54b4dc6b3387ea762d7e4ae and project a297ef598b76404b86e9350e120b86c9. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:24:55.663050 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-9e6c4190-92cf-4a4d-a44c-e436348780d7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.323627 Aug 23 22:24:55.664980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:24:55.667086 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 13/32] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:24:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 2330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:24:55.675264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:24:55.913225 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-10b90fc0-b2d7-4064-9949-b5c175520422 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.905360 Aug 23 22:24:55.926339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 20/33] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:24:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:24:55.970285 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-899983c7-dfe7-438f-a3e4-b5eda7a152e4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:55.971428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-899983c7-dfe7-438f-a3e4-b5eda7a152e4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:24:56.437308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-899983c7-dfe7-438f-a3e4-b5eda7a152e4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:24:56.510522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-899983c7-dfe7-438f-a3e4-b5eda7a152e4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1221 microversion: 2.1 time: 0.582447 Aug 23 22:24:56.518746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 21/34] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:24:55 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1221 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:24:56.540406 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-24399480-1924-4983-9663-45930c105ae1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:56.553234 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-24399480-1924-4983-9663-45930c105ae1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:24:56.571112 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-845357201", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "networks": [{"uuid": "8896bbdb-81c9-4e5c-a617-cc4bd70d74ad"}]}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:56.941827 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.network.neutron [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] validate_networks() for [('8896bbdb-81c9-4e5c-a617-cc4bd70d74ad', None, None, None, None, None)] {{(pid=120855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:24:56.998059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-24399480-1924-4983-9663-45930c105ae1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:24:57.070409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-24399480-1924-4983-9663-45930c105ae1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:24:57.085374 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-24399480-1924-4983-9663-45930c105ae1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:24:57.091667 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-24399480-1924-4983-9663-45930c105ae1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1281 microversion: 2.20 time: 0.570574 Aug 23 22:24:57.128011 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 22/35] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:24:56 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1281 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:24:57.186146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5fa3b046-0373-40bd-a9ef-78c50699b2ba tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:57.206519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5fa3b046-0373-40bd-a9ef-78c50699b2ba tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:24:57.507297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5fa3b046-0373-40bd-a9ef-78c50699b2ba tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:24:57.535078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5fa3b046-0373-40bd-a9ef-78c50699b2ba tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1241 microversion: 2.1 time: 0.404715 Aug 23 22:24:57.546266 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 23/36] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:24:57 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1241 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:24:57.555413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e7478c77-737a-41bb-b590-1c0b81a6325a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:57.559569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e7478c77-737a-41bb-b590-1c0b81a6325a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:24:57.781249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e7478c77-737a-41bb-b590-1c0b81a6325a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:24:57.817696 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e7478c77-737a-41bb-b590-1c0b81a6325a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1237 microversion: 2.1 time: 0.268928 Aug 23 22:24:57.818760 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 24/37] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:24:57 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1237 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:24:57.845888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-622885436", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:24:58.037549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] validate_networks() for [('6d954100-70c0-4f0f-a697-9d74a7a12bf8', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:24:59.009676 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Flavor limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:24:59.010427 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Image limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:24:59.011308 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Flavor pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:24:59.012109 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Image pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:24:59.013444 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:24:59.062588 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:59.064676 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:59.065503 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:59.084041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:59.086789 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:59.088935 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:59.183172 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Getting quotas for project 398769c58d0d412aa45024c937820ba1. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:24:59.201243 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Getting quotas for user 4e884c4f24db45a786618fc28d19bced and project 398769c58d0d412aa45024c937820ba1. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:24:59.244134 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Going to run 1 instances... {{(pid=120855) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:24:59.251215 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:24:59.392734 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e79e0335-5c48-47bc-8a6c-6c7ff40f87ac tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.722551 Aug 23 22:24:59.397660 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 14/38] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:24:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:24:59.438203 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:24:59.440166 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:24:59.481500 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:59.483611 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:59.486246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:59.488210 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:59.489324 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:59.490305 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:59.494120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:24:59.495086 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:24:59.495964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:24:59.496750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:24:59.497600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:24:59.500996 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=8 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:59.538224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:59.542433 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:59.543569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:59.546743 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:24:59.547549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:24:59.548264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:24:59.635450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Getting quotas for project 1dfc84dc05d542d987194096f3b7e51a. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:24:59.666430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Getting quotas for user 78b05a538ce0466ea8b3e27a0a6fc162 and project 1dfc84dc05d542d987194096f3b7e51a. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:24:59.756603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:24:59.772755 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:24:59.882739 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8d1c1bd2-8780-4c4b-a7a7-5fd4bf5272e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.061459 Aug 23 22:24:59.895168 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 25/39] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:24:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:25:00.033444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-78accc53-535f-4b27-8721-a351d59647c1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:00.036349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-78accc53-535f-4b27-8721-a351d59647c1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:00.078984 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78accc53-535f-4b27-8721-a351d59647c1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:00.083413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78accc53-535f-4b27-8721-a351d59647c1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:00.088829 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78accc53-535f-4b27-8721-a351d59647c1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:00.089947 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78accc53-535f-4b27-8721-a351d59647c1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:00.093871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78accc53-535f-4b27-8721-a351d59647c1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:00.099452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78accc53-535f-4b27-8721-a351d59647c1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:00.282619 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:00.446355 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:00.464057 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:00.477261 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-dac3a251-32bb-4cbf-8062-c545a5e9ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1333 microversion: 2.20 time: 1.062195 Aug 23 22:25:00.489639 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 15/40] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:24:59 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1333 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:00.529480 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-188d8fa4-fa60-4f7e-9356-30b1ad9f042c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:00.530616 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-188d8fa4-fa60-4f7e-9356-30b1ad9f042c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:00.585761 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-188d8fa4-fa60-4f7e-9356-30b1ad9f042c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:00.586762 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-188d8fa4-fa60-4f7e-9356-30b1ad9f042c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:00.587531 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-188d8fa4-fa60-4f7e-9356-30b1ad9f042c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:00.588780 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-188d8fa4-fa60-4f7e-9356-30b1ad9f042c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:00.602885 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-188d8fa4-fa60-4f7e-9356-30b1ad9f042c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:00.622031 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-188d8fa4-fa60-4f7e-9356-30b1ad9f042c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:01.050765 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-188d8fa4-fa60-4f7e-9356-30b1ad9f042c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:01.110032 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-188d8fa4-fa60-4f7e-9356-30b1ad9f042c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1289 microversion: 2.1 time: 0.618254 Aug 23 22:25:01.111552 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 16/41] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:00 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1289 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:01.125158 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-c0771ca7-2141-44e2-8e21-5af56c4c1491 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:01.127077 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-c0771ca7-2141-44e2-8e21-5af56c4c1491 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:01.477408 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c0771ca7-2141-44e2-8e21-5af56c4c1491 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:01.564901 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-c0771ca7-2141-44e2-8e21-5af56c4c1491 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1214 microversion: 2.1 time: 0.450953 Aug 23 22:25:01.588372 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 17/42] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:01 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1214 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:01.641993 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7d8a3940-f9b8-41d2-bb3a-9d0296ebc0d4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:01.643137 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7d8a3940-f9b8-41d2-bb3a-9d0296ebc0d4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:01.837712 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-78accc53-535f-4b27-8721-a351d59647c1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:01.940108 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-78accc53-535f-4b27-8721-a351d59647c1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1293 microversion: 2.1 time: 1.979784 Aug 23 22:25:01.947508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 26/43] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:24:59 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1293 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:02.013959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:02.023771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:02.090715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:02.102784 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:02.103858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:02.104938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:02.109904 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:02.110628 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:02.131904 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7d8a3940-f9b8-41d2-bb3a-9d0296ebc0d4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:02.189494 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7d8a3940-f9b8-41d2-bb3a-9d0296ebc0d4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1221 microversion: 2.1 time: 0.592245 Aug 23 22:25:02.197116 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 18/44] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:01 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1221 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:02.227567 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d8ca1525-8c71-4940-bd1b-d1e2a93cc6d4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:02.228735 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d8ca1525-8c71-4940-bd1b-d1e2a93cc6d4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:02.260846 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d8ca1525-8c71-4940-bd1b-d1e2a93cc6d4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:02.267578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d8ca1525-8c71-4940-bd1b-d1e2a93cc6d4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:02.268941 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d8ca1525-8c71-4940-bd1b-d1e2a93cc6d4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:02.275141 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d8ca1525-8c71-4940-bd1b-d1e2a93cc6d4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:02.279175 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d8ca1525-8c71-4940-bd1b-d1e2a93cc6d4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:02.283700 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d8ca1525-8c71-4940-bd1b-d1e2a93cc6d4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:02.663273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:02.688537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:02.694381 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d8ca1525-8c71-4940-bd1b-d1e2a93cc6d4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:02.699502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:02.702588 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5d9c847e-ec5a-4a94-9d3c-ff1f67527e57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1339 microversion: 2.20 time: 0.753182 Aug 23 22:25:02.704369 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 27/45] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:01 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1339 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:02.711408 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9bc270d7-1327-47bc-bab7-4c091f17edd1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:02.718060 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9bc270d7-1327-47bc-bab7-4c091f17edd1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:02.729714 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bc270d7-1327-47bc-bab7-4c091f17edd1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:02.730731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bc270d7-1327-47bc-bab7-4c091f17edd1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:02.731478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bc270d7-1327-47bc-bab7-4c091f17edd1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:02.732792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bc270d7-1327-47bc-bab7-4c091f17edd1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:02.733953 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bc270d7-1327-47bc-bab7-4c091f17edd1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:02.748375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bc270d7-1327-47bc-bab7-4c091f17edd1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:02.769371 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d8ca1525-8c71-4940-bd1b-d1e2a93cc6d4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1297 microversion: 2.1 time: 0.563845 Aug 23 22:25:02.776334 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 19/46] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:02 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1297 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:03.009023 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7697c07d-443f-48e1-8beb-eb4ebafbeade tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:03.018439 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7697c07d-443f-48e1-8beb-eb4ebafbeade tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:03.032689 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9bc270d7-1327-47bc-bab7-4c091f17edd1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:03.054992 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9bc270d7-1327-47bc-bab7-4c091f17edd1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1266 microversion: 2.1 time: 0.336847 Aug 23 22:25:03.058958 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 28/47] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:02 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1266 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:03.100876 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7697c07d-443f-48e1-8beb-eb4ebafbeade tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:03.114739 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7697c07d-443f-48e1-8beb-eb4ebafbeade tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:03.117285 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7697c07d-443f-48e1-8beb-eb4ebafbeade tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:03.121584 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7697c07d-443f-48e1-8beb-eb4ebafbeade tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:03.127302 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7697c07d-443f-48e1-8beb-eb4ebafbeade tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:03.128539 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7697c07d-443f-48e1-8beb-eb4ebafbeade tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:03.211846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-85cee992-74a5-4099-bf6f-323ede162073 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:03.212496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-85cee992-74a5-4099-bf6f-323ede162073 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:03.222980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-85cee992-74a5-4099-bf6f-323ede162073 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:03.223373 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-85cee992-74a5-4099-bf6f-323ede162073 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:03.223804 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-85cee992-74a5-4099-bf6f-323ede162073 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:03.224480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-85cee992-74a5-4099-bf6f-323ede162073 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:03.224883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-85cee992-74a5-4099-bf6f-323ede162073 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:03.225371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-85cee992-74a5-4099-bf6f-323ede162073 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:03.599348 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7697c07d-443f-48e1-8beb-eb4ebafbeade tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:03.653563 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7697c07d-443f-48e1-8beb-eb4ebafbeade tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1299 microversion: 2.1 time: 0.659862 Aug 23 22:25:03.660268 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 20/48] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:02 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1299 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:03.758144 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:03.760663 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:03.794684 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:03.801082 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:03.813487 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:03.821456 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:03.833371 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:03.834973 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:03.920419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-85cee992-74a5-4099-bf6f-323ede162073 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:03.961438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-85cee992-74a5-4099-bf6f-323ede162073 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1217 microversion: 2.1 time: 0.742972 Aug 23 22:25:03.976746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 29/49] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:03 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1217 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:03.998857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-01856995-3d71-4fb2-9ae7-ed60ac52a7df tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:04.000116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-01856995-3d71-4fb2-9ae7-ed60ac52a7df tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:04.024906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-01856995-3d71-4fb2-9ae7-ed60ac52a7df tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:04.025868 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-01856995-3d71-4fb2-9ae7-ed60ac52a7df tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:04.026561 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-01856995-3d71-4fb2-9ae7-ed60ac52a7df tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:04.027827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-01856995-3d71-4fb2-9ae7-ed60ac52a7df tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:04.034030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-01856995-3d71-4fb2-9ae7-ed60ac52a7df tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:04.035387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-01856995-3d71-4fb2-9ae7-ed60ac52a7df tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:04.401569 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:04.430927 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:04.440678 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:04.444167 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-132ca3fd-cc05-4ca9-9b78-7778e3be95e9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1339 microversion: 2.20 time: 0.698960 Aug 23 22:25:04.473656 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 21/50] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:03 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1339 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:25:04.487780 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bfe2254f-8637-40d3-b664-13464303585a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:04.489002 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-bfe2254f-8637-40d3-b664-13464303585a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:04.504468 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfe2254f-8637-40d3-b664-13464303585a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:04.517309 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfe2254f-8637-40d3-b664-13464303585a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:04.520328 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfe2254f-8637-40d3-b664-13464303585a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:04.526699 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfe2254f-8637-40d3-b664-13464303585a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:04.527710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfe2254f-8637-40d3-b664-13464303585a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:04.528549 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfe2254f-8637-40d3-b664-13464303585a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:05.515394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-01856995-3d71-4fb2-9ae7-ed60ac52a7df tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:05.587042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-01856995-3d71-4fb2-9ae7-ed60ac52a7df tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1295 microversion: 2.1 time: 1.606677 Aug 23 22:25:05.604796 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 30/51] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:03 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1295 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:05.648152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0a8dae95-8ad1-47b9-895a-f5ecf9e8d708 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:05.648777 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0a8dae95-8ad1-47b9-895a-f5ecf9e8d708 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:05.664174 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-bfe2254f-8637-40d3-b664-13464303585a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:05.679310 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a8dae95-8ad1-47b9-895a-f5ecf9e8d708 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:05.683974 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-bfe2254f-8637-40d3-b664-13464303585a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1272 microversion: 2.1 time: 1.204907 Aug 23 22:25:05.684918 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a8dae95-8ad1-47b9-895a-f5ecf9e8d708 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:05.685741 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a8dae95-8ad1-47b9-895a-f5ecf9e8d708 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:05.694473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a8dae95-8ad1-47b9-895a-f5ecf9e8d708 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:05.694473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a8dae95-8ad1-47b9-895a-f5ecf9e8d708 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:05.695196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a8dae95-8ad1-47b9-895a-f5ecf9e8d708 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:05.698727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 22/52] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:04 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1272 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:05.715212 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bd787af4-c3a4-4624-938c-a91b8f5ab67e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:05.717085 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-bd787af4-c3a4-4624-938c-a91b8f5ab67e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:05.733691 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bd787af4-c3a4-4624-938c-a91b8f5ab67e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:05.734206 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bd787af4-c3a4-4624-938c-a91b8f5ab67e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:05.734687 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bd787af4-c3a4-4624-938c-a91b8f5ab67e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:05.735432 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bd787af4-c3a4-4624-938c-a91b8f5ab67e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:05.735950 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bd787af4-c3a4-4624-938c-a91b8f5ab67e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:05.736391 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bd787af4-c3a4-4624-938c-a91b8f5ab67e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:06.440165 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-bd787af4-c3a4-4624-938c-a91b8f5ab67e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:06.456594 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-bd787af4-c3a4-4624-938c-a91b8f5ab67e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1279 microversion: 2.1 time: 0.749318 Aug 23 22:25:06.457578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 23/53] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:05 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1279 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:06.468462 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:06.472315 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:06.494898 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:06.496003 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:06.497007 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:06.499607 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:06.501672 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:06.503209 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:06.928681 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:06.964611 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:06.968557 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:06.994562 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7ff2c21f-dd0d-4e58-8cb4-00bb2903e2a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1339 microversion: 2.20 time: 0.528646 Aug 23 22:25:06.997926 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 24/54] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:06 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1339 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:07.039885 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-174d2315-706b-41c1-b7ff-d52119c247c3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:07.044843 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-174d2315-706b-41c1-b7ff-d52119c247c3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:07.090517 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174d2315-706b-41c1-b7ff-d52119c247c3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:07.092169 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174d2315-706b-41c1-b7ff-d52119c247c3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:07.099190 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174d2315-706b-41c1-b7ff-d52119c247c3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:07.102588 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174d2315-706b-41c1-b7ff-d52119c247c3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:07.105501 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174d2315-706b-41c1-b7ff-d52119c247c3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:07.107714 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174d2315-706b-41c1-b7ff-d52119c247c3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:08.183281 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-174d2315-706b-41c1-b7ff-d52119c247c3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:08.201731 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-174d2315-706b-41c1-b7ff-d52119c247c3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1295 microversion: 2.1 time: 1.196013 Aug 23 22:25:08.203326 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 25/55] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:07 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1295 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:08.221478 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d55b991c-f214-4ca3-b67b-325a04aa9234 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:08.224519 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d55b991c-f214-4ca3-b67b-325a04aa9234 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:08.249577 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d55b991c-f214-4ca3-b67b-325a04aa9234 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:08.252259 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d55b991c-f214-4ca3-b67b-325a04aa9234 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:08.256292 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d55b991c-f214-4ca3-b67b-325a04aa9234 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:08.258053 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d55b991c-f214-4ca3-b67b-325a04aa9234 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:08.267250 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d55b991c-f214-4ca3-b67b-325a04aa9234 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:08.268640 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d55b991c-f214-4ca3-b67b-325a04aa9234 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:08.678848 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d55b991c-f214-4ca3-b67b-325a04aa9234 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:08.718905 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d55b991c-f214-4ca3-b67b-325a04aa9234 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1272 microversion: 2.1 time: 0.500417 Aug 23 22:25:08.720423 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 26/56] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:08 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1272 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:08.760484 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3385f208-f119-41b9-90f7-c5ac8e195484 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:08.768673 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3385f208-f119-41b9-90f7-c5ac8e195484 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:08.812720 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3385f208-f119-41b9-90f7-c5ac8e195484 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:08.815449 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3385f208-f119-41b9-90f7-c5ac8e195484 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:08.818094 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3385f208-f119-41b9-90f7-c5ac8e195484 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:08.819790 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3385f208-f119-41b9-90f7-c5ac8e195484 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:08.823835 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3385f208-f119-41b9-90f7-c5ac8e195484 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:08.826090 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3385f208-f119-41b9-90f7-c5ac8e195484 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:09.139421 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=6 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:09.395157 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0a8dae95-8ad1-47b9-895a-f5ecf9e8d708 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:09.422420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0a8dae95-8ad1-47b9-895a-f5ecf9e8d708 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 3.810317 Aug 23 22:25:09.425288 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 31/57] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:05 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 3817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:09.438077 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:09.443754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:09.464329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:09.466823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:09.471918 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:09.475380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:09.477109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:09.478738 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:09.605216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=6 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:09.708310 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=26 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:11.083817 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3385f208-f119-41b9-90f7-c5ac8e195484 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:11.110821 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3385f208-f119-41b9-90f7-c5ac8e195484 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 2.380017 Aug 23 22:25:11.116864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 27/58] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:08 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 2390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:11.139771 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-9f855f0c-c149-41b7-93bf-c0a90455cd66 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:11.141932 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9f855f0c-c149-41b7-93bf-c0a90455cd66 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:11.150081 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:11.180712 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9f855f0c-c149-41b7-93bf-c0a90455cd66 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:11.180712 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9f855f0c-c149-41b7-93bf-c0a90455cd66 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:11.180712 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9f855f0c-c149-41b7-93bf-c0a90455cd66 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:11.180712 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9f855f0c-c149-41b7-93bf-c0a90455cd66 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:11.181246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9f855f0c-c149-41b7-93bf-c0a90455cd66 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:11.181542 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9f855f0c-c149-41b7-93bf-c0a90455cd66 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:11.739562 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:11.791092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:11.802758 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:11.811281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-38e5c204-caf1-4f64-a9f9-9842d7ac0d30 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 2.383305 Aug 23 22:25:11.812509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 32/59] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:09 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 2387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:11.852499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f0eeb36d-6660-4b15-bf72-d90a43e9b387 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:11.853147 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f0eeb36d-6660-4b15-bf72-d90a43e9b387 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:11.871438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0eeb36d-6660-4b15-bf72-d90a43e9b387 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:11.873667 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0eeb36d-6660-4b15-bf72-d90a43e9b387 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:11.874333 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0eeb36d-6660-4b15-bf72-d90a43e9b387 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:11.875328 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0eeb36d-6660-4b15-bf72-d90a43e9b387 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:11.876554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0eeb36d-6660-4b15-bf72-d90a43e9b387 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:11.882200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0eeb36d-6660-4b15-bf72-d90a43e9b387 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:12.177744 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=22 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:12.464524 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f0eeb36d-6660-4b15-bf72-d90a43e9b387 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:12.489216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f0eeb36d-6660-4b15-bf72-d90a43e9b387 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1272 microversion: 2.1 time: 0.651552 Aug 23 22:25:12.491449 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 33/60] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:11 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1272 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:12.507898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-45d2c00c-c574-4035-9cef-aae8d1e98b7b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:12.509010 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-45d2c00c-c574-4035-9cef-aae8d1e98b7b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:12.545002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-45d2c00c-c574-4035-9cef-aae8d1e98b7b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:12.546761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-45d2c00c-c574-4035-9cef-aae8d1e98b7b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:12.549332 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-45d2c00c-c574-4035-9cef-aae8d1e98b7b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:12.550851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-45d2c00c-c574-4035-9cef-aae8d1e98b7b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:12.555337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-45d2c00c-c574-4035-9cef-aae8d1e98b7b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:12.560861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-45d2c00c-c574-4035-9cef-aae8d1e98b7b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:12.629086 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9f855f0c-c149-41b7-93bf-c0a90455cd66 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:12.657218 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-9f855f0c-c149-41b7-93bf-c0a90455cd66 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 1.535068 Aug 23 22:25:12.671642 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 28/61] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:11 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:12.710638 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-2e3adc24-eae6-48d6-9a87-1a440da3479a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:12.712161 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-2e3adc24-eae6-48d6-9a87-1a440da3479a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:12.738827 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2e3adc24-eae6-48d6-9a87-1a440da3479a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:12.740895 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2e3adc24-eae6-48d6-9a87-1a440da3479a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:12.742616 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2e3adc24-eae6-48d6-9a87-1a440da3479a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:12.743974 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2e3adc24-eae6-48d6-9a87-1a440da3479a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:12.745147 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2e3adc24-eae6-48d6-9a87-1a440da3479a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:12.748293 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2e3adc24-eae6-48d6-9a87-1a440da3479a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:13.323309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-45d2c00c-c574-4035-9cef-aae8d1e98b7b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:13.346634 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-2e3adc24-eae6-48d6-9a87-1a440da3479a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:13.384631 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-2e3adc24-eae6-48d6-9a87-1a440da3479a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 0.695681 Aug 23 22:25:13.386124 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-45d2c00c-c574-4035-9cef-aae8d1e98b7b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.892415 Aug 23 22:25:13.389489 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 34/62] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:12 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:13.409632 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 29/63] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:12 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:13.412817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:13.414382 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:13.428139 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:13.428965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:13.429767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:13.431199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:13.431958 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:13.432907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:13.520431 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-92cfc465-3d41-451b-a735-fa597a5e4bbc tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:13.522625 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-92cfc465-3d41-451b-a735-fa597a5e4bbc tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:13.538442 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92cfc465-3d41-451b-a735-fa597a5e4bbc tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:13.539389 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92cfc465-3d41-451b-a735-fa597a5e4bbc tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:13.540332 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92cfc465-3d41-451b-a735-fa597a5e4bbc tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:13.542038 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92cfc465-3d41-451b-a735-fa597a5e4bbc tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:13.543128 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92cfc465-3d41-451b-a735-fa597a5e4bbc tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:13.544772 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92cfc465-3d41-451b-a735-fa597a5e4bbc tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:14.005146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:14.063630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:14.080727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:14.087014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-55dcff93-f900-4aec-9324-dd080cfc1f7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.693377 Aug 23 22:25:14.090417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 35/64] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:13 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:14.109977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9fdcf70d-3ab5-4083-9429-ff1f5e6ef90c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:14.113375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9fdcf70d-3ab5-4083-9429-ff1f5e6ef90c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:14.143916 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fdcf70d-3ab5-4083-9429-ff1f5e6ef90c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:14.144409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fdcf70d-3ab5-4083-9429-ff1f5e6ef90c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:14.146181 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fdcf70d-3ab5-4083-9429-ff1f5e6ef90c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:14.148836 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fdcf70d-3ab5-4083-9429-ff1f5e6ef90c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:14.150491 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fdcf70d-3ab5-4083-9429-ff1f5e6ef90c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:14.151178 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fdcf70d-3ab5-4083-9429-ff1f5e6ef90c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:15.049073 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9fdcf70d-3ab5-4083-9429-ff1f5e6ef90c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:15.080195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9fdcf70d-3ab5-4083-9429-ff1f5e6ef90c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.983961 Aug 23 22:25:15.080935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 36/65] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:14 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:15.107402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-408b83c9-4717-40b0-8ce2-2822332f8d67 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:15.108068 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-408b83c9-4717-40b0-8ce2-2822332f8d67 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:15.119726 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-408b83c9-4717-40b0-8ce2-2822332f8d67 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:15.120287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-408b83c9-4717-40b0-8ce2-2822332f8d67 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:15.120935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-408b83c9-4717-40b0-8ce2-2822332f8d67 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:15.123341 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-408b83c9-4717-40b0-8ce2-2822332f8d67 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:15.124067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-408b83c9-4717-40b0-8ce2-2822332f8d67 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:15.124946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-408b83c9-4717-40b0-8ce2-2822332f8d67 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:15.560164 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-92cfc465-3d41-451b-a735-fa597a5e4bbc tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:15.582999 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-92cfc465-3d41-451b-a735-fa597a5e4bbc tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 2.070552 Aug 23 22:25:15.589981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 30/66] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:13 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:15.597226 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-05640e93-08a4-44e9-a633-7485140f3e11 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:15.597619 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-05640e93-08a4-44e9-a633-7485140f3e11 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:15.625450 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05640e93-08a4-44e9-a633-7485140f3e11 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:15.626311 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05640e93-08a4-44e9-a633-7485140f3e11 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:15.627151 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05640e93-08a4-44e9-a633-7485140f3e11 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:15.628260 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05640e93-08a4-44e9-a633-7485140f3e11 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:15.628977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05640e93-08a4-44e9-a633-7485140f3e11 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:15.629604 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05640e93-08a4-44e9-a633-7485140f3e11 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:16.664364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-05640e93-08a4-44e9-a633-7485140f3e11 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:16.683335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-05640e93-08a4-44e9-a633-7485140f3e11 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 1.091582 Aug 23 22:25:16.686743 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 31/67] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:15 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:17.456983 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-bf02c315-82af-4744-8372-b3d7a8c481cf req-a51ae5a5-23fe-4d37-86f8-d5a07abb9a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a32adbd-853b-47ce-b461-e82363494a37", "tag": "44698636-efef-43cf-a8ef-8c14ed7f08ab"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:17.498032 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-bf02c315-82af-4744-8372-b3d7a8c481cf req-a51ae5a5-23fe-4d37-86f8-d5a07abb9a5d service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:17.498709 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-bf02c315-82af-4744-8372-b3d7a8c481cf req-a51ae5a5-23fe-4d37-86f8-d5a07abb9a5d service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:17.499406 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-bf02c315-82af-4744-8372-b3d7a8c481cf req-a51ae5a5-23fe-4d37-86f8-d5a07abb9a5d service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:17.611200 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-bf02c315-82af-4744-8372-b3d7a8c481cf req-a51ae5a5-23fe-4d37-86f8-d5a07abb9a5d service nova] Creating event network-changed:44698636-efef-43cf-a8ef-8c14ed7f08ab for instance 8a32adbd-853b-47ce-b461-e82363494a37 on hv-cinder-85032 Aug 23 22:25:17.612891 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-bf02c315-82af-4744-8372-b3d7a8c481cf req-a51ae5a5-23fe-4d37-86f8-d5a07abb9a5d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120855) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 22:25:17.614240 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-bf02c315-82af-4744-8372-b3d7a8c481cf req-a51ae5a5-23fe-4d37-86f8-d5a07abb9a5d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120855) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 22:25:17.616295 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1ec34546-ec5c-4c2c-bbf3-213f93d514fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:17.617270 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1ec34546-ec5c-4c2c-bbf3-213f93d514fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:17.618278 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1ec34546-ec5c-4c2c-bbf3-213f93d514fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:17.619737 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1ec34546-ec5c-4c2c-bbf3-213f93d514fa None None] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:17.620521 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1ec34546-ec5c-4c2c-bbf3-213f93d514fa None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:17.621331 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1ec34546-ec5c-4c2c-bbf3-213f93d514fa None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:17.662334 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=100 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:17.672147 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.compute.rpcapi [None req-1ec34546-ec5c-4c2c-bbf3-213f93d514fa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 22:25:17.674154 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1ec34546-ec5c-4c2c-bbf3-213f93d514fa None None] Releasing lock "compute-rpcapi-router" {{(pid=120855) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 22:25:17.714549 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-1ec34546-ec5c-4c2c-bbf3-213f93d514fa None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.024619 Aug 23 22:25:17.717443 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 32/68] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:17.750331 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:17.751805 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:17.782900 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:17.785319 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:17.788982 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:17.791983 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:17.798126 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:17.799701 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:18.354444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-408b83c9-4717-40b0-8ce2-2822332f8d67 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:18.398849 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-408b83c9-4717-40b0-8ce2-2822332f8d67 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 3.298931 Aug 23 22:25:18.402813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 37/69] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:15 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 3320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:18.438946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-620693b8-f3ac-4e67-a20a-5ba3f24837dc tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:18.440679 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-620693b8-f3ac-4e67-a20a-5ba3f24837dc tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:18.487392 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-620693b8-f3ac-4e67-a20a-5ba3f24837dc tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:18.491353 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-620693b8-f3ac-4e67-a20a-5ba3f24837dc tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:18.495423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-620693b8-f3ac-4e67-a20a-5ba3f24837dc tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:18.499034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-620693b8-f3ac-4e67-a20a-5ba3f24837dc tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:18.502076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-620693b8-f3ac-4e67-a20a-5ba3f24837dc tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:18.504499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-620693b8-f3ac-4e67-a20a-5ba3f24837dc tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:18.819186 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:18.860325 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:18.864604 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:18.875933 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-c8f7fdd1-fa2f-4506-ad11-9256826d76e5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 1.155047 Aug 23 22:25:18.890043 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 33/70] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:17 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:18.899744 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bc54dba7-49d6-4a50-b3f1-f93f934d93b9 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:18.901340 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-bc54dba7-49d6-4a50-b3f1-f93f934d93b9 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:18.923098 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bc54dba7-49d6-4a50-b3f1-f93f934d93b9 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:18.923849 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bc54dba7-49d6-4a50-b3f1-f93f934d93b9 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:18.925165 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bc54dba7-49d6-4a50-b3f1-f93f934d93b9 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:18.929458 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bc54dba7-49d6-4a50-b3f1-f93f934d93b9 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:18.930218 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bc54dba7-49d6-4a50-b3f1-f93f934d93b9 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:18.930828 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bc54dba7-49d6-4a50-b3f1-f93f934d93b9 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:19.607693 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-bc54dba7-49d6-4a50-b3f1-f93f934d93b9 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:19.645763 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-bc54dba7-49d6-4a50-b3f1-f93f934d93b9 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.753323 Aug 23 22:25:19.654905 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 34/71] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:18 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:19.680502 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a0fc9ede-753e-4600-876d-9ba591384b8c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:19.690512 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a0fc9ede-753e-4600-876d-9ba591384b8c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:19.714789 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0fc9ede-753e-4600-876d-9ba591384b8c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:19.716846 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0fc9ede-753e-4600-876d-9ba591384b8c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:19.718112 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0fc9ede-753e-4600-876d-9ba591384b8c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:19.720007 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0fc9ede-753e-4600-876d-9ba591384b8c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:19.721570 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0fc9ede-753e-4600-876d-9ba591384b8c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:19.722832 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0fc9ede-753e-4600-876d-9ba591384b8c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:20.137411 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-620693b8-f3ac-4e67-a20a-5ba3f24837dc tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:20.163431 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-620693b8-f3ac-4e67-a20a-5ba3f24837dc tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 1.751572 Aug 23 22:25:20.164541 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 38/72] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:18 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:20.220271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a0fc9ede-753e-4600-876d-9ba591384b8c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:20.236321 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a0fc9ede-753e-4600-876d-9ba591384b8c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.579025 Aug 23 22:25:20.237781 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 35/73] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:19 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:20.247983 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-dd9e92cb-9f73-461a-902d-61bfbc280900 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:20.249652 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-dd9e92cb-9f73-461a-902d-61bfbc280900 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:20.264856 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd9e92cb-9f73-461a-902d-61bfbc280900 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:20.266187 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd9e92cb-9f73-461a-902d-61bfbc280900 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:20.267231 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd9e92cb-9f73-461a-902d-61bfbc280900 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:20.268838 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd9e92cb-9f73-461a-902d-61bfbc280900 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:20.275580 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd9e92cb-9f73-461a-902d-61bfbc280900 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:20.276561 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd9e92cb-9f73-461a-902d-61bfbc280900 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:20.661580 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-9f723d1e-c47c-4237-aafa-811700a2babb req-c2da4c7f-23a1-4e55-aef9-29b6fac2442e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd812373-cfc2-4d5e-8230-2e0a72153994", "tag": "614d514f-5113-4d77-8846-ee45da0b972d"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:20.696188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9f723d1e-c47c-4237-aafa-811700a2babb req-c2da4c7f-23a1-4e55-aef9-29b6fac2442e service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:20.699256 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9f723d1e-c47c-4237-aafa-811700a2babb req-c2da4c7f-23a1-4e55-aef9-29b6fac2442e service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:20.701647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9f723d1e-c47c-4237-aafa-811700a2babb req-c2da4c7f-23a1-4e55-aef9-29b6fac2442e service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:20.756019 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-9f723d1e-c47c-4237-aafa-811700a2babb req-c2da4c7f-23a1-4e55-aef9-29b6fac2442e service nova] Creating event network-changed:614d514f-5113-4d77-8846-ee45da0b972d for instance fd812373-cfc2-4d5e-8230-2e0a72153994 on hv-cinder-85032 Aug 23 22:25:20.757552 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9f723d1e-c47c-4237-aafa-811700a2babb req-c2da4c7f-23a1-4e55-aef9-29b6fac2442e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120856) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 22:25:20.758290 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9f723d1e-c47c-4237-aafa-811700a2babb req-c2da4c7f-23a1-4e55-aef9-29b6fac2442e service nova] Acquired lock "compute-rpcapi-router" {{(pid=120856) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 22:25:20.760708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b92e06b-1375-4544-a32f-d3073842947a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:20.763464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b92e06b-1375-4544-a32f-d3073842947a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:20.764286 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b92e06b-1375-4544-a32f-d3073842947a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:20.767107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b92e06b-1375-4544-a32f-d3073842947a None None] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:20.768389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b92e06b-1375-4544-a32f-d3073842947a None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:20.769214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b92e06b-1375-4544-a32f-d3073842947a None None] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:20.800690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.compute.rpcapi [None req-3b92e06b-1375-4544-a32f-d3073842947a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 22:25:20.802948 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b92e06b-1375-4544-a32f-d3073842947a None None] Releasing lock "compute-rpcapi-router" {{(pid=120856) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 22:25:20.856927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3b92e06b-1375-4544-a32f-d3073842947a None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.687277 Aug 23 22:25:20.858189 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 39/74] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:20.865412 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-4bcabec7-99d2-4ac7-bad6-ca95479c9b60 req-9d683d14-9372-416c-845e-7cfc3f0a8b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b06356-525c-4c7f-9b5a-f9d0424f9dba", "tag": "29e126aa-d7f5-470c-b76d-c8d4bd7e7849"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:20.881230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-4bcabec7-99d2-4ac7-bad6-ca95479c9b60 req-9d683d14-9372-416c-845e-7cfc3f0a8b72 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:20.881948 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-4bcabec7-99d2-4ac7-bad6-ca95479c9b60 req-9d683d14-9372-416c-845e-7cfc3f0a8b72 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:20.882596 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-4bcabec7-99d2-4ac7-bad6-ca95479c9b60 req-9d683d14-9372-416c-845e-7cfc3f0a8b72 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:20.902692 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-4bcabec7-99d2-4ac7-bad6-ca95479c9b60 req-9d683d14-9372-416c-845e-7cfc3f0a8b72 service nova] Creating event network-changed:29e126aa-d7f5-470c-b76d-c8d4bd7e7849 for instance 61b06356-525c-4c7f-9b5a-f9d0424f9dba on hv-cinder-85032 Aug 23 22:25:20.911058 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-4bcabec7-99d2-4ac7-bad6-ca95479c9b60 req-9d683d14-9372-416c-845e-7cfc3f0a8b72 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050649 Aug 23 22:25:20.912954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 40/75] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:20.921978 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:20.922889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:20.933413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:20.934230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:20.935179 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:20.936473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:20.937491 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:20.938132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:20.975188 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-dd9e92cb-9f73-461a-902d-61bfbc280900 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:21.009546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-dd9e92cb-9f73-461a-902d-61bfbc280900 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 0.769595 Aug 23 22:25:21.016014 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 36/76] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:20 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:21.042232 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-46531aad-2215-4548-aff5-01edc6019d79 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:21.047125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-46531aad-2215-4548-aff5-01edc6019d79 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:21.082856 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46531aad-2215-4548-aff5-01edc6019d79 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:21.084299 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46531aad-2215-4548-aff5-01edc6019d79 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:21.086585 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46531aad-2215-4548-aff5-01edc6019d79 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:21.087926 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46531aad-2215-4548-aff5-01edc6019d79 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:21.088805 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46531aad-2215-4548-aff5-01edc6019d79 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:21.089644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46531aad-2215-4548-aff5-01edc6019d79 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:21.559247 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-46531aad-2215-4548-aff5-01edc6019d79 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:21.577182 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-46531aad-2215-4548-aff5-01edc6019d79 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.558853 Aug 23 22:25:21.578742 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 37/77] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:21 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:21.587175 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-eb68366c-bfd3-4752-ae61-ab5adbb28d06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:21.588388 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-eb68366c-bfd3-4752-ae61-ab5adbb28d06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:21.609654 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb68366c-bfd3-4752-ae61-ab5adbb28d06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:21.610444 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb68366c-bfd3-4752-ae61-ab5adbb28d06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:21.611231 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb68366c-bfd3-4752-ae61-ab5adbb28d06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:21.612300 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb68366c-bfd3-4752-ae61-ab5adbb28d06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:21.613240 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb68366c-bfd3-4752-ae61-ab5adbb28d06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:21.613959 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb68366c-bfd3-4752-ae61-ab5adbb28d06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:22.022708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:22.025620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=95 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:22.034937 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:22.036904 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:22.038937 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6bfd89c3-1e0e-463f-8458-926fc6e79171 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 1.124226 Aug 23 22:25:22.039715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 41/78] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:20 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:22.046761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d42da815-3a49-4ec8-8b33-3255fc4ea290 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:22.047767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d42da815-3a49-4ec8-8b33-3255fc4ea290 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:22.067428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42da815-3a49-4ec8-8b33-3255fc4ea290 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:22.068214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42da815-3a49-4ec8-8b33-3255fc4ea290 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:22.068941 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42da815-3a49-4ec8-8b33-3255fc4ea290 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:22.069896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42da815-3a49-4ec8-8b33-3255fc4ea290 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:22.070529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42da815-3a49-4ec8-8b33-3255fc4ea290 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:22.071105 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42da815-3a49-4ec8-8b33-3255fc4ea290 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:22.156071 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-eb68366c-bfd3-4752-ae61-ab5adbb28d06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:22.166395 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-eb68366c-bfd3-4752-ae61-ab5adbb28d06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.585860 Aug 23 22:25:22.167071 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 38/79] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:21 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:22.203849 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-44cf92bd-28af-493d-9db5-e02a54443f9e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:22.205366 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-44cf92bd-28af-493d-9db5-e02a54443f9e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:22.226066 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-44cf92bd-28af-493d-9db5-e02a54443f9e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:22.229688 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-44cf92bd-28af-493d-9db5-e02a54443f9e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:22.233691 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-44cf92bd-28af-493d-9db5-e02a54443f9e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:22.234707 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-44cf92bd-28af-493d-9db5-e02a54443f9e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:22.235344 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-44cf92bd-28af-493d-9db5-e02a54443f9e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:22.235899 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-44cf92bd-28af-493d-9db5-e02a54443f9e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:22.447706 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-44cf92bd-28af-493d-9db5-e02a54443f9e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:22.465119 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-44cf92bd-28af-493d-9db5-e02a54443f9e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 0.296712 Aug 23 22:25:22.466952 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 39/80] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:22 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:22.585179 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d42da815-3a49-4ec8-8b33-3255fc4ea290 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:22.595157 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d42da815-3a49-4ec8-8b33-3255fc4ea290 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.553620 Aug 23 22:25:22.610111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 42/81] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:22 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:22.628680 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-0acb6937-b09d-4a27-bade-0b21d11f2242 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:22.630874 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-0acb6937-b09d-4a27-bade-0b21d11f2242 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:22.639914 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0acb6937-b09d-4a27-bade-0b21d11f2242 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:22.640852 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0acb6937-b09d-4a27-bade-0b21d11f2242 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:22.641648 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0acb6937-b09d-4a27-bade-0b21d11f2242 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:22.643046 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0acb6937-b09d-4a27-bade-0b21d11f2242 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:22.643596 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0acb6937-b09d-4a27-bade-0b21d11f2242 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:22.644535 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0acb6937-b09d-4a27-bade-0b21d11f2242 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:22.874991 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-0acb6937-b09d-4a27-bade-0b21d11f2242 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:22.887009 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-0acb6937-b09d-4a27-bade-0b21d11f2242 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.275735 Aug 23 22:25:22.888773 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 40/82] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:22 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:22.911057 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-34945bad-e70f-4df5-bbbe-f1e9620fe1c5 req-ed55deac-479f-4d3f-aafd-e23ae97d016c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b697da-19f2-459e-a57e-e386523e4bcf", "tag": "5867c0e1-ac00-4c87-bd75-9ca953635248"}, {"name": "network-changed", "server_uuid": "1f6155d4-fda2-4409-83f8-0a03e54559bd", "tag": "2a039e7d-6c60-4fc6-aeeb-33c9d72e8c2e"}, {"name": "network-changed", "server_uuid": "498d6e2f-6d66-4925-8f7c-eca5b08c1025", "tag": "3da5a208-32b6-480a-96ee-d5e85aa6ca75"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:22.928911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-34945bad-e70f-4df5-bbbe-f1e9620fe1c5 req-ed55deac-479f-4d3f-aafd-e23ae97d016c service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:22.930318 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-34945bad-e70f-4df5-bbbe-f1e9620fe1c5 req-ed55deac-479f-4d3f-aafd-e23ae97d016c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:22.930931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-34945bad-e70f-4df5-bbbe-f1e9620fe1c5 req-ed55deac-479f-4d3f-aafd-e23ae97d016c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:22.958831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-34945bad-e70f-4df5-bbbe-f1e9620fe1c5 req-ed55deac-479f-4d3f-aafd-e23ae97d016c service nova] Creating event network-changed:5867c0e1-ac00-4c87-bd75-9ca953635248 for instance 80b697da-19f2-459e-a57e-e386523e4bcf on hv-cinder-85032 Aug 23 22:25:22.959549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-34945bad-e70f-4df5-bbbe-f1e9620fe1c5 req-ed55deac-479f-4d3f-aafd-e23ae97d016c service nova] Creating event network-changed:2a039e7d-6c60-4fc6-aeeb-33c9d72e8c2e for instance 1f6155d4-fda2-4409-83f8-0a03e54559bd on hv-cinder-85032 Aug 23 22:25:22.960217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-34945bad-e70f-4df5-bbbe-f1e9620fe1c5 req-ed55deac-479f-4d3f-aafd-e23ae97d016c service nova] Creating event network-changed:3da5a208-32b6-480a-96ee-d5e85aa6ca75 for instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 on hv-cinder-85032 Aug 23 22:25:22.974067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-34945bad-e70f-4df5-bbbe-f1e9620fe1c5 req-ed55deac-479f-4d3f-aafd-e23ae97d016c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.068290 Aug 23 22:25:22.975464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 43/83] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:23.085093 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:23.086280 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:23.102432 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:23.103830 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:23.104563 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:23.105744 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:23.107199 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:23.108140 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:23.218411 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-857b223d-a910-4763-973a-e26aebd1d220 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:23.219176 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-857b223d-a910-4763-973a-e26aebd1d220 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:23.228519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-857b223d-a910-4763-973a-e26aebd1d220 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:23.229045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-857b223d-a910-4763-973a-e26aebd1d220 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:23.229515 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-857b223d-a910-4763-973a-e26aebd1d220 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:23.230252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-857b223d-a910-4763-973a-e26aebd1d220 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:23.232522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-857b223d-a910-4763-973a-e26aebd1d220 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:23.234720 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-857b223d-a910-4763-973a-e26aebd1d220 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:23.330150 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:23.332785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:23.335149 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:23.336579 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-32ff0d95-c1b2-4f09-87de-6e07c3003e1a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.259346 Aug 23 22:25:23.350009 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 41/84] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:23 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:25:23.414746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-857b223d-a910-4763-973a-e26aebd1d220 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:23.426353 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-857b223d-a910-4763-973a-e26aebd1d220 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.213209 Aug 23 22:25:23.437149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 44/85] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:23 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:23.490151 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-913afcd4-f010-4a44-a0f0-951beff0318f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:23.490774 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-913afcd4-f010-4a44-a0f0-951beff0318f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:23.498699 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-913afcd4-f010-4a44-a0f0-951beff0318f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:23.499205 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-913afcd4-f010-4a44-a0f0-951beff0318f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:23.499720 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-913afcd4-f010-4a44-a0f0-951beff0318f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:23.500367 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-913afcd4-f010-4a44-a0f0-951beff0318f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:23.501008 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-913afcd4-f010-4a44-a0f0-951beff0318f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:23.501469 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-913afcd4-f010-4a44-a0f0-951beff0318f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:23.627837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0ba4d429-f1cd-4b35-b579-51718b995ed9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:23.629338 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0ba4d429-f1cd-4b35-b579-51718b995ed9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:23.651196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ba4d429-f1cd-4b35-b579-51718b995ed9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:23.666506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ba4d429-f1cd-4b35-b579-51718b995ed9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:23.667615 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ba4d429-f1cd-4b35-b579-51718b995ed9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:23.669308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ba4d429-f1cd-4b35-b579-51718b995ed9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:23.670389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ba4d429-f1cd-4b35-b579-51718b995ed9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:23.671221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ba4d429-f1cd-4b35-b579-51718b995ed9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:24.063857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0ba4d429-f1cd-4b35-b579-51718b995ed9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:24.074402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0ba4d429-f1cd-4b35-b579-51718b995ed9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.453708 Aug 23 22:25:24.093390 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 45/86] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:23 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:24.100065 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b0f68edf-b6c6-4b9d-a898-ddb15bf2131d tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:24.101164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b0f68edf-b6c6-4b9d-a898-ddb15bf2131d tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:24.110006 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0f68edf-b6c6-4b9d-a898-ddb15bf2131d tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:24.110635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0f68edf-b6c6-4b9d-a898-ddb15bf2131d tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:24.111071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0f68edf-b6c6-4b9d-a898-ddb15bf2131d tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:24.113046 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0f68edf-b6c6-4b9d-a898-ddb15bf2131d tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:24.113574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0f68edf-b6c6-4b9d-a898-ddb15bf2131d tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:24.114018 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0f68edf-b6c6-4b9d-a898-ddb15bf2131d tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:24.170594 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-913afcd4-f010-4a44-a0f0-951beff0318f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:24.191262 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-913afcd4-f010-4a44-a0f0-951beff0318f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 0.704836 Aug 23 22:25:24.205452 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 42/87] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:23 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:24.292035 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b0f68edf-b6c6-4b9d-a898-ddb15bf2131d tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:24.302265 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b0f68edf-b6c6-4b9d-a898-ddb15bf2131d tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.207018 Aug 23 22:25:24.302872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 46/88] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:24 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:24.363436 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:24.363436 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:24.371316 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:24.372808 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:24.373385 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:24.374102 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:24.375123 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:24.375568 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:24.450957 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-963bcee7-882e-4744-8517-d3d45b01add9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:24.452117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-963bcee7-882e-4744-8517-d3d45b01add9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:24.459893 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-963bcee7-882e-4744-8517-d3d45b01add9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:24.460653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-963bcee7-882e-4744-8517-d3d45b01add9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:24.461574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-963bcee7-882e-4744-8517-d3d45b01add9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:24.463453 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-963bcee7-882e-4744-8517-d3d45b01add9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:24.464411 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-963bcee7-882e-4744-8517-d3d45b01add9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:24.464972 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-963bcee7-882e-4744-8517-d3d45b01add9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:24.897147 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:24.923002 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:24.933204 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:24.936849 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3912e228-14d8-42e0-bc13-5ff60149095e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.576877 Aug 23 22:25:24.942912 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 43/89] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:24 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:25:25.105815 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-9e56f4c7-cbfc-49cb-a20d-e503d3fba045 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:25.111090 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9e56f4c7-cbfc-49cb-a20d-e503d3fba045 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:25.134520 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e56f4c7-cbfc-49cb-a20d-e503d3fba045 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:25.136123 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e56f4c7-cbfc-49cb-a20d-e503d3fba045 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:25.137384 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e56f4c7-cbfc-49cb-a20d-e503d3fba045 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:25.140496 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e56f4c7-cbfc-49cb-a20d-e503d3fba045 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:25.143022 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e56f4c7-cbfc-49cb-a20d-e503d3fba045 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:25.145655 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9e56f4c7-cbfc-49cb-a20d-e503d3fba045 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:25.177947 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-963bcee7-882e-4744-8517-d3d45b01add9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:25.196039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-963bcee7-882e-4744-8517-d3d45b01add9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.750756 Aug 23 22:25:25.201282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 47/90] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:24 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:25.212511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7740e283-78ab-4fdf-9a0a-b18070a581d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:25.214855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7740e283-78ab-4fdf-9a0a-b18070a581d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:25.230447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7740e283-78ab-4fdf-9a0a-b18070a581d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:25.235190 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7740e283-78ab-4fdf-9a0a-b18070a581d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:25.238966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7740e283-78ab-4fdf-9a0a-b18070a581d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:25.241747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7740e283-78ab-4fdf-9a0a-b18070a581d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:25.247924 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7740e283-78ab-4fdf-9a0a-b18070a581d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:25.249009 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7740e283-78ab-4fdf-9a0a-b18070a581d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:25.711638 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9e56f4c7-cbfc-49cb-a20d-e503d3fba045 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:25.725372 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-9e56f4c7-cbfc-49cb-a20d-e503d3fba045 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.629343 Aug 23 22:25:25.737571 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 44/91] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:25 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:25.747730 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e7b6b2b8-99ba-4298-9961-e72817ddf438 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:25.749346 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e7b6b2b8-99ba-4298-9961-e72817ddf438 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:25.793016 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e7b6b2b8-99ba-4298-9961-e72817ddf438 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:25.796486 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e7b6b2b8-99ba-4298-9961-e72817ddf438 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:25.797546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e7b6b2b8-99ba-4298-9961-e72817ddf438 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:25.814462 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e7b6b2b8-99ba-4298-9961-e72817ddf438 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:25.818680 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e7b6b2b8-99ba-4298-9961-e72817ddf438 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:25.820147 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e7b6b2b8-99ba-4298-9961-e72817ddf438 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:26.220457 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e7b6b2b8-99ba-4298-9961-e72817ddf438 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:26.231845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e7b6b2b8-99ba-4298-9961-e72817ddf438 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.492349 Aug 23 22:25:26.239357 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 45/92] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:25 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:26.255085 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:26.255671 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:26.296855 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:26.298229 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:26.299543 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:26.303261 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:26.305086 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:26.308206 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:26.626863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7740e283-78ab-4fdf-9a0a-b18070a581d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:26.652954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7740e283-78ab-4fdf-9a0a-b18070a581d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 1.433490 Aug 23 22:25:26.654625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 48/93] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:25 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:26.661599 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-87d54003-bdbb-4bd9-a47f-913ba72e5c8c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:26.661599 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-87d54003-bdbb-4bd9-a47f-913ba72e5c8c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:26.681311 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d54003-bdbb-4bd9-a47f-913ba72e5c8c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:26.681863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d54003-bdbb-4bd9-a47f-913ba72e5c8c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:26.682879 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d54003-bdbb-4bd9-a47f-913ba72e5c8c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:26.687356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d54003-bdbb-4bd9-a47f-913ba72e5c8c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:26.688226 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d54003-bdbb-4bd9-a47f-913ba72e5c8c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:26.688824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d54003-bdbb-4bd9-a47f-913ba72e5c8c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:26.743842 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:26.758511 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:26.762977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:26.765454 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ce1212de-5b53-4c36-a2ec-c7e60ff29060 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.522352 Aug 23 22:25:26.767168 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 46/94] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:26 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:26.777193 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-c6693880-ad8a-483b-ab36-97dde26749e1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:26.778368 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-c6693880-ad8a-483b-ab36-97dde26749e1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:26.790552 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6693880-ad8a-483b-ab36-97dde26749e1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:26.791483 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6693880-ad8a-483b-ab36-97dde26749e1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:26.792986 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6693880-ad8a-483b-ab36-97dde26749e1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:26.794551 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6693880-ad8a-483b-ab36-97dde26749e1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:26.795417 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6693880-ad8a-483b-ab36-97dde26749e1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:26.796215 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6693880-ad8a-483b-ab36-97dde26749e1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:27.055990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-87d54003-bdbb-4bd9-a47f-913ba72e5c8c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:27.075823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-87d54003-bdbb-4bd9-a47f-913ba72e5c8c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.417719 Aug 23 22:25:27.076775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 49/95] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:26 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:27.163823 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c6693880-ad8a-483b-ab36-97dde26749e1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:27.176563 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-c6693880-ad8a-483b-ab36-97dde26749e1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.407353 Aug 23 22:25:27.178587 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 47/96] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:26 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:27.257014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e790ea18-91cb-4279-98ea-3a3326410b51 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:27.257778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e790ea18-91cb-4279-98ea-3a3326410b51 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:27.268749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e790ea18-91cb-4279-98ea-3a3326410b51 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:27.271116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e790ea18-91cb-4279-98ea-3a3326410b51 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:27.272230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e790ea18-91cb-4279-98ea-3a3326410b51 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:27.274331 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e790ea18-91cb-4279-98ea-3a3326410b51 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:27.275309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e790ea18-91cb-4279-98ea-3a3326410b51 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:27.279123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e790ea18-91cb-4279-98ea-3a3326410b51 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:27.567606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e790ea18-91cb-4279-98ea-3a3326410b51 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:27.580722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e790ea18-91cb-4279-98ea-3a3326410b51 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.328096 Aug 23 22:25:27.581821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 50/97] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:27 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:27.702526 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-98e2674f-d294-4d63-acdf-16ee495731f6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:27.702526 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-98e2674f-d294-4d63-acdf-16ee495731f6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:27.713638 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=2 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:27.726024 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98e2674f-d294-4d63-acdf-16ee495731f6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:27.741038 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98e2674f-d294-4d63-acdf-16ee495731f6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:27.742246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98e2674f-d294-4d63-acdf-16ee495731f6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:27.744045 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98e2674f-d294-4d63-acdf-16ee495731f6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:27.749302 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98e2674f-d294-4d63-acdf-16ee495731f6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:27.751975 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98e2674f-d294-4d63-acdf-16ee495731f6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:27.797733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:27.814710 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:27.835762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:27.839348 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:27.844230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:27.845804 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:27.853221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:27.855123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:28.221774 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-98e2674f-d294-4d63-acdf-16ee495731f6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:28.261725 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-98e2674f-d294-4d63-acdf-16ee495731f6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 0.571236 Aug 23 22:25:28.266176 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 48/98] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:27 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:28.292246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-4b41cf97-4e44-4cb1-b31b-b82f0ec04d4c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:28.296362 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-4b41cf97-4e44-4cb1-b31b-b82f0ec04d4c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:28.323921 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b41cf97-4e44-4cb1-b31b-b82f0ec04d4c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:28.330229 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b41cf97-4e44-4cb1-b31b-b82f0ec04d4c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:28.331161 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b41cf97-4e44-4cb1-b31b-b82f0ec04d4c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:28.332355 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b41cf97-4e44-4cb1-b31b-b82f0ec04d4c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:28.333012 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b41cf97-4e44-4cb1-b31b-b82f0ec04d4c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:28.333661 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b41cf97-4e44-4cb1-b31b-b82f0ec04d4c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:28.356848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:28.369552 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=100 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:28.374208 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:28.375741 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:28.376898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-56e0659c-0521-492d-882c-7c8b0a0bcccc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.589501 Aug 23 22:25:28.382832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 51/99] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:27 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:28.389162 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e60ab094-61e6-486c-a52a-fd4f074799fc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:28.389803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e60ab094-61e6-486c-a52a-fd4f074799fc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:28.396574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e60ab094-61e6-486c-a52a-fd4f074799fc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:28.397112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e60ab094-61e6-486c-a52a-fd4f074799fc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:28.397610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e60ab094-61e6-486c-a52a-fd4f074799fc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:28.398403 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e60ab094-61e6-486c-a52a-fd4f074799fc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:28.398854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e60ab094-61e6-486c-a52a-fd4f074799fc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:28.399281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e60ab094-61e6-486c-a52a-fd4f074799fc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:28.602738 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-4b41cf97-4e44-4cb1-b31b-b82f0ec04d4c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:28.620180 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-4b41cf97-4e44-4cb1-b31b-b82f0ec04d4c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.350964 Aug 23 22:25:28.634600 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 49/100] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:28 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:28.634600 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b876fe2a-c361-454a-978f-adf0e6863bde tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:28.634600 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-b876fe2a-c361-454a-978f-adf0e6863bde tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:28.638080 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b876fe2a-c361-454a-978f-adf0e6863bde tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:28.638752 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b876fe2a-c361-454a-978f-adf0e6863bde tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:28.639430 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b876fe2a-c361-454a-978f-adf0e6863bde tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:28.640548 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b876fe2a-c361-454a-978f-adf0e6863bde tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:28.641558 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b876fe2a-c361-454a-978f-adf0e6863bde tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:28.641999 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b876fe2a-c361-454a-978f-adf0e6863bde tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:28.694578 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e60ab094-61e6-486c-a52a-fd4f074799fc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:28.704932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e60ab094-61e6-486c-a52a-fd4f074799fc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.320906 Aug 23 22:25:28.716345 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 52/101] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:28 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:28.820600 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-b876fe2a-c361-454a-978f-adf0e6863bde tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:28.829408 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-b876fe2a-c361-454a-978f-adf0e6863bde tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.206164 Aug 23 22:25:28.830003 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 50/102] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:28 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:29.305135 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6f94bf60-bab4-4e9f-aaa1-fae81d926e30 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:29.306382 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6f94bf60-bab4-4e9f-aaa1-fae81d926e30 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:29.329614 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f94bf60-bab4-4e9f-aaa1-fae81d926e30 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:29.332924 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f94bf60-bab4-4e9f-aaa1-fae81d926e30 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:29.334008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f94bf60-bab4-4e9f-aaa1-fae81d926e30 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:29.336902 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f94bf60-bab4-4e9f-aaa1-fae81d926e30 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:29.338021 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f94bf60-bab4-4e9f-aaa1-fae81d926e30 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:29.339993 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f94bf60-bab4-4e9f-aaa1-fae81d926e30 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:29.417630 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:29.419692 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:29.445404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:29.445404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:29.446878 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:29.452793 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:29.453570 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:29.454280 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:29.761923 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:29.783555 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6f94bf60-bab4-4e9f-aaa1-fae81d926e30 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:29.807746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6f94bf60-bab4-4e9f-aaa1-fae81d926e30 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 0.508341 Aug 23 22:25:29.809155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 53/103] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:29 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:29.820856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-733091d3-02cd-414f-877a-33ea18a677fe tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:29.821901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-733091d3-02cd-414f-877a-33ea18a677fe tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:29.824130 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:29.831191 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:29.842992 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:29.855476 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d01a2dd4-a3ab-433c-ba95-ca84c3f0341c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.444271 Aug 23 22:25:29.865743 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-733091d3-02cd-414f-877a-33ea18a677fe tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:29.866242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-733091d3-02cd-414f-877a-33ea18a677fe tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:29.867728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 51/104] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:29 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:25:29.869421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-733091d3-02cd-414f-877a-33ea18a677fe tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:29.870243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-733091d3-02cd-414f-877a-33ea18a677fe tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:29.870702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-733091d3-02cd-414f-877a-33ea18a677fe tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:29.871136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-733091d3-02cd-414f-877a-33ea18a677fe tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:29.889617 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-dced3572-f2de-46ed-9d29-038a87213e0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:29.894109 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-dced3572-f2de-46ed-9d29-038a87213e0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:29.923255 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dced3572-f2de-46ed-9d29-038a87213e0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:29.923762 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dced3572-f2de-46ed-9d29-038a87213e0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:29.925123 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dced3572-f2de-46ed-9d29-038a87213e0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:29.926173 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dced3572-f2de-46ed-9d29-038a87213e0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:29.926813 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dced3572-f2de-46ed-9d29-038a87213e0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:29.927555 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dced3572-f2de-46ed-9d29-038a87213e0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:30.185307 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-dced3572-f2de-46ed-9d29-038a87213e0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:30.207934 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-dced3572-f2de-46ed-9d29-038a87213e0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.338589 Aug 23 22:25:30.209951 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 52/105] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:29 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:30.222911 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7d9f94ad-f56d-41de-9e42-93ee0c036f8c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:30.223780 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7d9f94ad-f56d-41de-9e42-93ee0c036f8c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:30.230085 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d9f94ad-f56d-41de-9e42-93ee0c036f8c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:30.231481 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d9f94ad-f56d-41de-9e42-93ee0c036f8c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:30.232317 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d9f94ad-f56d-41de-9e42-93ee0c036f8c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:30.233337 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d9f94ad-f56d-41de-9e42-93ee0c036f8c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:30.234033 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d9f94ad-f56d-41de-9e42-93ee0c036f8c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:30.234664 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d9f94ad-f56d-41de-9e42-93ee0c036f8c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:30.359534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-733091d3-02cd-414f-877a-33ea18a677fe tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:30.374953 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-733091d3-02cd-414f-877a-33ea18a677fe tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.564439 Aug 23 22:25:30.375708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 54/106] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:29 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:30.539693 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7d9f94ad-f56d-41de-9e42-93ee0c036f8c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:30.551578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7d9f94ad-f56d-41de-9e42-93ee0c036f8c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.339693 Aug 23 22:25:30.561170 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 53/107] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:30 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:30.845715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cc0cd3a8-565b-42d1-b445-3e290ca321d7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:30.846715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cc0cd3a8-565b-42d1-b445-3e290ca321d7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:30.851215 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:30.867946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc0cd3a8-565b-42d1-b445-3e290ca321d7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:30.869299 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc0cd3a8-565b-42d1-b445-3e290ca321d7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:30.870052 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc0cd3a8-565b-42d1-b445-3e290ca321d7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:30.874163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc0cd3a8-565b-42d1-b445-3e290ca321d7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:30.875283 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc0cd3a8-565b-42d1-b445-3e290ca321d7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:30.875919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc0cd3a8-565b-42d1-b445-3e290ca321d7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:30.895410 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:30.896694 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:30.910107 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:30.910939 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:30.913164 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:30.916105 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:30.916900 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:30.919587 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:31.260923 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:31.282053 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:31.286128 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:31.290163 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d46b7a9d-2cac-47d4-b96f-ce0178e07e9d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.398925 Aug 23 22:25:31.307061 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 54/108] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:30 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:25:31.318503 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-cc0cd3a8-565b-42d1-b445-3e290ca321d7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:31.346970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cc0cd3a8-565b-42d1-b445-3e290ca321d7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 0.508252 Aug 23 22:25:31.348014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 55/109] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:30 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:31.356134 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5bb8c3f0-ed06-481e-a6d6-17e1019fcc18 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:31.367295 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5bb8c3f0-ed06-481e-a6d6-17e1019fcc18 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:31.391922 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5bb8c3f0-ed06-481e-a6d6-17e1019fcc18 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:31.393016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5bb8c3f0-ed06-481e-a6d6-17e1019fcc18 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:31.393985 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5bb8c3f0-ed06-481e-a6d6-17e1019fcc18 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:31.395435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5bb8c3f0-ed06-481e-a6d6-17e1019fcc18 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:31.396474 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5bb8c3f0-ed06-481e-a6d6-17e1019fcc18 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:31.397266 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5bb8c3f0-ed06-481e-a6d6-17e1019fcc18 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:31.671055 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5bb8c3f0-ed06-481e-a6d6-17e1019fcc18 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:31.680605 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5bb8c3f0-ed06-481e-a6d6-17e1019fcc18 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.331178 Aug 23 22:25:31.681319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 56/110] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:31 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:31.687088 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b2f4673f-568b-42b1-9505-5be7e8c53201 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:31.696146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b2f4673f-568b-42b1-9505-5be7e8c53201 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:31.696146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2f4673f-568b-42b1-9505-5be7e8c53201 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:31.696146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2f4673f-568b-42b1-9505-5be7e8c53201 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:31.696146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2f4673f-568b-42b1-9505-5be7e8c53201 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:31.697540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2f4673f-568b-42b1-9505-5be7e8c53201 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:31.697540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2f4673f-568b-42b1-9505-5be7e8c53201 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:31.697540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2f4673f-568b-42b1-9505-5be7e8c53201 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:31.886393 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b2f4673f-568b-42b1-9505-5be7e8c53201 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:31.896796 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-f2987c13-7c51-4aab-99d9-7337bc680e59 req-eb0cda69-d350-4ba4-bfc4-771d3944581e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b06356-525c-4c7f-9b5a-f9d0424f9dba", "name": "network-vif-plugged", "status": "completed", "tag": "29e126aa-d7f5-470c-b76d-c8d4bd7e7849"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:31.907520 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b2f4673f-568b-42b1-9505-5be7e8c53201 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.225091 Aug 23 22:25:31.908110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 57/111] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:31 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:31.912215 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-f2987c13-7c51-4aab-99d9-7337bc680e59 req-eb0cda69-d350-4ba4-bfc4-771d3944581e service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:31.912734 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-f2987c13-7c51-4aab-99d9-7337bc680e59 req-eb0cda69-d350-4ba4-bfc4-771d3944581e service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:31.913219 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-f2987c13-7c51-4aab-99d9-7337bc680e59 req-eb0cda69-d350-4ba4-bfc4-771d3944581e service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:31.921995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-155d183d-d84f-42a5-b398-2f3cb77b32fd tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:31.922616 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-155d183d-d84f-42a5-b398-2f3cb77b32fd tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:31.932907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-155d183d-d84f-42a5-b398-2f3cb77b32fd tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:31.933189 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-f2987c13-7c51-4aab-99d9-7337bc680e59 req-eb0cda69-d350-4ba4-bfc4-771d3944581e service nova] Creating event network-vif-plugged:29e126aa-d7f5-470c-b76d-c8d4bd7e7849 for instance 61b06356-525c-4c7f-9b5a-f9d0424f9dba on hv-cinder-85032 Aug 23 22:25:31.933484 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-155d183d-d84f-42a5-b398-2f3cb77b32fd tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:31.934585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-155d183d-d84f-42a5-b398-2f3cb77b32fd tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:31.935537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-155d183d-d84f-42a5-b398-2f3cb77b32fd tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:31.935997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-155d183d-d84f-42a5-b398-2f3cb77b32fd tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:31.936405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-155d183d-d84f-42a5-b398-2f3cb77b32fd tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:31.939750 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-f2987c13-7c51-4aab-99d9-7337bc680e59 req-eb0cda69-d350-4ba4-bfc4-771d3944581e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.630395 Aug 23 22:25:31.940683 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 55/112] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:32.126283 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-155d183d-d84f-42a5-b398-2f3cb77b32fd tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:32.137107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-155d183d-d84f-42a5-b398-2f3cb77b32fd tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.218663 Aug 23 22:25:32.138688 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 58/113] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:31 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:32.334751 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:32.335905 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:32.346677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:32.346677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:32.346677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:32.346677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:32.347032 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:32.347032 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:32.381402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9d8bb786-b1a2-46cc-953c-233099b62db0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:32.382769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9d8bb786-b1a2-46cc-953c-233099b62db0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:32.390245 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d8bb786-b1a2-46cc-953c-233099b62db0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:32.390831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d8bb786-b1a2-46cc-953c-233099b62db0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:32.391657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d8bb786-b1a2-46cc-953c-233099b62db0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:32.392645 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d8bb786-b1a2-46cc-953c-233099b62db0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:32.393536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d8bb786-b1a2-46cc-953c-233099b62db0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:32.394125 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d8bb786-b1a2-46cc-953c-233099b62db0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:32.399763 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=100 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:32.614711 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:32.624517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9d8bb786-b1a2-46cc-953c-233099b62db0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:32.627118 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:32.630125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:32.632440 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-01aa17f3-8583-405c-bb20-528f971363a5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.301687 Aug 23 22:25:32.636630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9d8bb786-b1a2-46cc-953c-233099b62db0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 0.259135 Aug 23 22:25:32.645790 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 56/114] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:32 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:32.646910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 59/115] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:32 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:32.704812 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-199c8956-3609-4ae3-b48f-80e8ae226766 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:32.705657 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-199c8956-3609-4ae3-b48f-80e8ae226766 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:32.713764 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-199c8956-3609-4ae3-b48f-80e8ae226766 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:32.714404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-199c8956-3609-4ae3-b48f-80e8ae226766 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:32.714844 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-199c8956-3609-4ae3-b48f-80e8ae226766 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:32.717101 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-199c8956-3609-4ae3-b48f-80e8ae226766 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:32.718348 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-199c8956-3609-4ae3-b48f-80e8ae226766 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:32.718966 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-199c8956-3609-4ae3-b48f-80e8ae226766 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:32.932806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-636ce9e1-9493-4662-9ba2-ab4ae2dd4e68 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:32.933725 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-636ce9e1-9493-4662-9ba2-ab4ae2dd4e68 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:32.951836 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-636ce9e1-9493-4662-9ba2-ab4ae2dd4e68 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:32.952620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-636ce9e1-9493-4662-9ba2-ab4ae2dd4e68 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:32.954077 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-636ce9e1-9493-4662-9ba2-ab4ae2dd4e68 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:32.955041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-636ce9e1-9493-4662-9ba2-ab4ae2dd4e68 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:32.958291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-636ce9e1-9493-4662-9ba2-ab4ae2dd4e68 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:32.959037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-636ce9e1-9493-4662-9ba2-ab4ae2dd4e68 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:32.963618 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-199c8956-3609-4ae3-b48f-80e8ae226766 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:32.992704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-199c8956-3609-4ae3-b48f-80e8ae226766 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.293253 Aug 23 22:25:33.007927 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 57/116] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:32 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:33.194134 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e8642793-c117-43b7-aa68-cf90591a26fb tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:33.195240 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e8642793-c117-43b7-aa68-cf90591a26fb tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:33.220000 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e8642793-c117-43b7-aa68-cf90591a26fb tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:33.222751 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e8642793-c117-43b7-aa68-cf90591a26fb tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:33.223328 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e8642793-c117-43b7-aa68-cf90591a26fb tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:33.224402 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e8642793-c117-43b7-aa68-cf90591a26fb tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:33.225252 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e8642793-c117-43b7-aa68-cf90591a26fb tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:33.226370 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e8642793-c117-43b7-aa68-cf90591a26fb tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:33.578667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e8642793-c117-43b7-aa68-cf90591a26fb tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:33.598664 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e8642793-c117-43b7-aa68-cf90591a26fb tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.429076 Aug 23 22:25:33.615876 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 58/117] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:33 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:33.663861 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:33.665010 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:33.683387 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:33.684083 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:33.685508 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:33.686255 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:33.686803 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:33.689548 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:33.694236 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-636ce9e1-9493-4662-9ba2-ab4ae2dd4e68 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:33.702612 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-636ce9e1-9493-4662-9ba2-ab4ae2dd4e68 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.778053 Aug 23 22:25:33.727117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 60/118] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:32 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:33.732368 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-25979283-f7bc-4718-b377-e00577c678f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:33.734894 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-25979283-f7bc-4718-b377-e00577c678f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:33.747571 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25979283-f7bc-4718-b377-e00577c678f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:33.753840 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25979283-f7bc-4718-b377-e00577c678f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:33.754576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25979283-f7bc-4718-b377-e00577c678f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:33.756491 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25979283-f7bc-4718-b377-e00577c678f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:33.757168 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25979283-f7bc-4718-b377-e00577c678f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:33.757935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25979283-f7bc-4718-b377-e00577c678f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:34.141436 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:34.160729 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:34.164160 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:34.165287 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-48513df2-c5a7-431b-bfe8-d571aff94bdb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.508088 Aug 23 22:25:34.166150 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 59/119] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:33 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:34.176866 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-676b5241-4830-48a9-82a8-05af5ee38dda req-c3515ab4-d554-4caf-bf43-2912705ab764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd812373-cfc2-4d5e-8230-2e0a72153994", "name": "network-vif-plugged", "status": "completed", "tag": "614d514f-5113-4d77-8846-ee45da0b972d"}, {"server_uuid": "8a32adbd-853b-47ce-b461-e82363494a37", "name": "network-vif-plugged", "status": "completed", "tag": "44698636-efef-43cf-a8ef-8c14ed7f08ab"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:34.222452 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-676b5241-4830-48a9-82a8-05af5ee38dda req-c3515ab4-d554-4caf-bf43-2912705ab764 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:34.223085 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-676b5241-4830-48a9-82a8-05af5ee38dda req-c3515ab4-d554-4caf-bf43-2912705ab764 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:34.223747 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-676b5241-4830-48a9-82a8-05af5ee38dda req-c3515ab4-d554-4caf-bf43-2912705ab764 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:34.260212 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-676b5241-4830-48a9-82a8-05af5ee38dda req-c3515ab4-d554-4caf-bf43-2912705ab764 service nova] Creating event network-vif-plugged:614d514f-5113-4d77-8846-ee45da0b972d for instance fd812373-cfc2-4d5e-8230-2e0a72153994 on hv-cinder-85032 Aug 23 22:25:34.269352 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-676b5241-4830-48a9-82a8-05af5ee38dda req-c3515ab4-d554-4caf-bf43-2912705ab764 service nova] Creating event network-vif-plugged:44698636-efef-43cf-a8ef-8c14ed7f08ab for instance 8a32adbd-853b-47ce-b461-e82363494a37 on hv-cinder-85032 Aug 23 22:25:34.300728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-676b5241-4830-48a9-82a8-05af5ee38dda req-c3515ab4-d554-4caf-bf43-2912705ab764 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.128912 Aug 23 22:25:34.306289 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 60/120] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:34.330812 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-2ed13975-b943-4fa6-960f-7618644c7a4b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:34.332202 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-2ed13975-b943-4fa6-960f-7618644c7a4b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:34.362595 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2ed13975-b943-4fa6-960f-7618644c7a4b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:34.364331 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2ed13975-b943-4fa6-960f-7618644c7a4b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:34.365179 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2ed13975-b943-4fa6-960f-7618644c7a4b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:34.366655 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2ed13975-b943-4fa6-960f-7618644c7a4b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:34.367971 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2ed13975-b943-4fa6-960f-7618644c7a4b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:34.371657 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2ed13975-b943-4fa6-960f-7618644c7a4b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:34.382590 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-25979283-f7bc-4718-b377-e00577c678f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:34.410371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-25979283-f7bc-4718-b377-e00577c678f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 0.680804 Aug 23 22:25:34.412418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 61/121] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:33 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:34.635763 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-96db49c7-ee5e-412e-b9f0-13e7e4dbd286 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:34.636527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-96db49c7-ee5e-412e-b9f0-13e7e4dbd286 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:34.643621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96db49c7-ee5e-412e-b9f0-13e7e4dbd286 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:34.644108 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96db49c7-ee5e-412e-b9f0-13e7e4dbd286 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:34.644739 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96db49c7-ee5e-412e-b9f0-13e7e4dbd286 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:34.645784 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96db49c7-ee5e-412e-b9f0-13e7e4dbd286 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:34.646465 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96db49c7-ee5e-412e-b9f0-13e7e4dbd286 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:34.647251 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96db49c7-ee5e-412e-b9f0-13e7e4dbd286 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:34.685442 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-2ed13975-b943-4fa6-960f-7618644c7a4b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:34.696490 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-2ed13975-b943-4fa6-960f-7618644c7a4b tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.388077 Aug 23 22:25:34.697453 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 61/122] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:34 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:34.725476 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-675745d5-749d-49bf-9d18-0bcefeb118e3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:34.726150 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-675745d5-749d-49bf-9d18-0bcefeb118e3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:34.750534 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-675745d5-749d-49bf-9d18-0bcefeb118e3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:34.751156 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-675745d5-749d-49bf-9d18-0bcefeb118e3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:34.751809 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-675745d5-749d-49bf-9d18-0bcefeb118e3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:34.763413 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-675745d5-749d-49bf-9d18-0bcefeb118e3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:34.764308 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-675745d5-749d-49bf-9d18-0bcefeb118e3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:34.765081 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-675745d5-749d-49bf-9d18-0bcefeb118e3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:35.022973 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-675745d5-749d-49bf-9d18-0bcefeb118e3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:35.032993 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-675745d5-749d-49bf-9d18-0bcefeb118e3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.311717 Aug 23 22:25:35.033633 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 62/123] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:34 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:35.199979 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:35.200685 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:35.207382 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:35.207877 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:35.208308 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:35.209035 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:35.209511 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:35.209962 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:35.262276 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-96db49c7-ee5e-412e-b9f0-13e7e4dbd286 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:35.273201 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-96db49c7-ee5e-412e-b9f0-13e7e4dbd286 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.642526 Aug 23 22:25:35.276156 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 62/124] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:34 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:35.371327 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:35.382871 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:35.384991 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:35.386770 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3dcd24fc-5af5-4e0e-a58f-f0b676068dc5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.191304 Aug 23 22:25:35.387883 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 63/125] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:35 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:25:35.441648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-32d0637c-ce94-43dd-8c6d-272e0ae1c97d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:35.442571 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-32d0637c-ce94-43dd-8c6d-272e0ae1c97d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:35.457764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-32d0637c-ce94-43dd-8c6d-272e0ae1c97d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:35.459313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-32d0637c-ce94-43dd-8c6d-272e0ae1c97d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:35.460085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-32d0637c-ce94-43dd-8c6d-272e0ae1c97d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:35.460881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-32d0637c-ce94-43dd-8c6d-272e0ae1c97d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:35.461616 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-32d0637c-ce94-43dd-8c6d-272e0ae1c97d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:35.462114 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-32d0637c-ce94-43dd-8c6d-272e0ae1c97d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:35.726372 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8b6bac9e-2711-40cc-a3c9-ab5a7c07ee6f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:35.727018 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-8b6bac9e-2711-40cc-a3c9-ab5a7c07ee6f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:35.737329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8b6bac9e-2711-40cc-a3c9-ab5a7c07ee6f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:35.737952 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8b6bac9e-2711-40cc-a3c9-ab5a7c07ee6f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:35.738596 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8b6bac9e-2711-40cc-a3c9-ab5a7c07ee6f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:35.739636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8b6bac9e-2711-40cc-a3c9-ab5a7c07ee6f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:35.740286 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8b6bac9e-2711-40cc-a3c9-ab5a7c07ee6f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:35.740881 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8b6bac9e-2711-40cc-a3c9-ab5a7c07ee6f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:35.871119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-32d0637c-ce94-43dd-8c6d-272e0ae1c97d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:35.897753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-32d0637c-ce94-43dd-8c6d-272e0ae1c97d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1321 microversion: 2.1 time: 0.461177 Aug 23 22:25:35.917895 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 63/126] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:35 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:35.944386 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8b6bac9e-2711-40cc-a3c9-ab5a7c07ee6f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:35.953822 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8b6bac9e-2711-40cc-a3c9-ab5a7c07ee6f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.231179 Aug 23 22:25:35.954427 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 64/127] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:35 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:36.065731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fa75c87b-d278-4c1e-bf54-18c92051b7f0 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:36.066619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fa75c87b-d278-4c1e-bf54-18c92051b7f0 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:36.086967 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa75c87b-d278-4c1e-bf54-18c92051b7f0 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:36.087452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa75c87b-d278-4c1e-bf54-18c92051b7f0 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:36.088142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa75c87b-d278-4c1e-bf54-18c92051b7f0 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:36.089085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa75c87b-d278-4c1e-bf54-18c92051b7f0 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:36.089694 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa75c87b-d278-4c1e-bf54-18c92051b7f0 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:36.090917 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa75c87b-d278-4c1e-bf54-18c92051b7f0 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:36.305735 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-65a50971-2851-4805-91d3-69c4220347e1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:36.307502 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-65a50971-2851-4805-91d3-69c4220347e1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:36.320524 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65a50971-2851-4805-91d3-69c4220347e1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:36.322780 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65a50971-2851-4805-91d3-69c4220347e1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:36.323533 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65a50971-2851-4805-91d3-69c4220347e1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:36.324634 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65a50971-2851-4805-91d3-69c4220347e1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:36.325447 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65a50971-2851-4805-91d3-69c4220347e1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:36.326283 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65a50971-2851-4805-91d3-69c4220347e1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:36.426741 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fa75c87b-d278-4c1e-bf54-18c92051b7f0 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:36.447474 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fa75c87b-d278-4c1e-bf54-18c92051b7f0 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.386835 Aug 23 22:25:36.449346 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 64/128] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:36 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:36.461265 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-ec24534e-7a55-46a7-9dfc-76ec18714e5e req-c59f07da-8751-4de2-a5c9-43d6d54323ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b697da-19f2-459e-a57e-e386523e4bcf", "name": "network-vif-plugged", "status": "completed", "tag": "5867c0e1-ac00-4c87-bd75-9ca953635248"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:36.483830 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-ec24534e-7a55-46a7-9dfc-76ec18714e5e req-c59f07da-8751-4de2-a5c9-43d6d54323ce service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:36.485915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-ec24534e-7a55-46a7-9dfc-76ec18714e5e req-c59f07da-8751-4de2-a5c9-43d6d54323ce service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:36.486987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-ec24534e-7a55-46a7-9dfc-76ec18714e5e req-c59f07da-8751-4de2-a5c9-43d6d54323ce service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:36.515194 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-ec24534e-7a55-46a7-9dfc-76ec18714e5e req-c59f07da-8751-4de2-a5c9-43d6d54323ce service nova] Creating event network-vif-plugged:5867c0e1-ac00-4c87-bd75-9ca953635248 for instance 80b697da-19f2-459e-a57e-e386523e4bcf on hv-cinder-85032 Aug 23 22:25:36.526147 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-ec24534e-7a55-46a7-9dfc-76ec18714e5e req-c59f07da-8751-4de2-a5c9-43d6d54323ce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070912 Aug 23 22:25:36.528250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 65/129] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:36.546290 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:36.547450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:36.558431 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:36.559696 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:36.560881 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-65a50971-2851-4805-91d3-69c4220347e1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:36.561124 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:36.562459 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:36.563122 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:36.563906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:36.607719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-65a50971-2851-4805-91d3-69c4220347e1 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.312977 Aug 23 22:25:36.608839 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 65/130] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:36 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:36.881564 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:36.901176 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:36.906415 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:36.909516 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a8afa558-9ef0-443d-9487-67c6b2f1b7d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.378175 Aug 23 22:25:36.911046 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 66/131] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:36 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:36.939375 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d10d192e-ba5e-4f75-8d0f-30f97d7039ff tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:36.944168 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d10d192e-ba5e-4f75-8d0f-30f97d7039ff tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:36.960066 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d10d192e-ba5e-4f75-8d0f-30f97d7039ff tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:36.961572 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d10d192e-ba5e-4f75-8d0f-30f97d7039ff tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:36.962650 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d10d192e-ba5e-4f75-8d0f-30f97d7039ff tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:36.966141 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d10d192e-ba5e-4f75-8d0f-30f97d7039ff tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:36.967280 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d10d192e-ba5e-4f75-8d0f-30f97d7039ff tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:36.968286 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d10d192e-ba5e-4f75-8d0f-30f97d7039ff tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:36.987406 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-171cfb19-afd1-4fee-9361-5663d492c110 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:36.988563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-171cfb19-afd1-4fee-9361-5663d492c110 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:37.013700 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-171cfb19-afd1-4fee-9361-5663d492c110 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:37.019566 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-171cfb19-afd1-4fee-9361-5663d492c110 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:37.024791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-171cfb19-afd1-4fee-9361-5663d492c110 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:37.029450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-171cfb19-afd1-4fee-9361-5663d492c110 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:37.030713 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-171cfb19-afd1-4fee-9361-5663d492c110 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:37.032997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-171cfb19-afd1-4fee-9361-5663d492c110 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:37.338618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-171cfb19-afd1-4fee-9361-5663d492c110 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:37.343212 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d10d192e-ba5e-4f75-8d0f-30f97d7039ff tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:37.354647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-171cfb19-afd1-4fee-9361-5663d492c110 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.379549 Aug 23 22:25:37.356511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 67/132] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:36 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:37.378321 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d10d192e-ba5e-4f75-8d0f-30f97d7039ff tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1515 microversion: 2.1 time: 0.447555 Aug 23 22:25:37.378932 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 66/133] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:36 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1515 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:37.428071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d1ca52df-2e35-4287-8597-c828d621d95b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:37.431897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d1ca52df-2e35-4287-8597-c828d621d95b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:37.444033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1ca52df-2e35-4287-8597-c828d621d95b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:37.445372 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1ca52df-2e35-4287-8597-c828d621d95b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:37.446495 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1ca52df-2e35-4287-8597-c828d621d95b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:37.448192 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1ca52df-2e35-4287-8597-c828d621d95b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:37.450309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1ca52df-2e35-4287-8597-c828d621d95b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:37.451702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1ca52df-2e35-4287-8597-c828d621d95b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:37.493691 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e075f648-b934-44dc-98b2-e9e4657b5644 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:37.498967 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e075f648-b934-44dc-98b2-e9e4657b5644 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:37.515940 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e075f648-b934-44dc-98b2-e9e4657b5644 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:37.516769 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e075f648-b934-44dc-98b2-e9e4657b5644 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:37.517539 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e075f648-b934-44dc-98b2-e9e4657b5644 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:37.519369 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e075f648-b934-44dc-98b2-e9e4657b5644 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:37.520082 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e075f648-b934-44dc-98b2-e9e4657b5644 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:37.520675 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e075f648-b934-44dc-98b2-e9e4657b5644 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:37.559677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=100 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:37.616313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-d1ca52df-2e35-4287-8597-c828d621d95b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lazy-loading 'flavor' on Instance uuid 61b06356-525c-4c7f-9b5a-f9d0424f9dba {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:25:37.804684 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e075f648-b934-44dc-98b2-e9e4657b5644 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:37.827015 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e075f648-b934-44dc-98b2-e9e4657b5644 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1362 microversion: 2.1 time: 0.341996 Aug 23 22:25:37.827510 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 67/134] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:37 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:37.845921 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-63468783-5b46-412b-8da6-308b3831e942 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:37.846591 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-63468783-5b46-412b-8da6-308b3831e942 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:37.853457 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-63468783-5b46-412b-8da6-308b3831e942 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:37.854239 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-63468783-5b46-412b-8da6-308b3831e942 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:37.854972 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-63468783-5b46-412b-8da6-308b3831e942 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:37.856571 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-63468783-5b46-412b-8da6-308b3831e942 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:37.857362 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-63468783-5b46-412b-8da6-308b3831e942 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:37.858008 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-63468783-5b46-412b-8da6-308b3831e942 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:37.952894 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d1ca52df-2e35-4287-8597-c828d621d95b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba/action" status: 200 len: 32 microversion: 2.1 time: 0.534503 Aug 23 22:25:37.954267 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 68/135] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:25:37 2022] POST /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba/action => generated 32 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:25:37.961736 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:37.962730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:37.972537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:37.973418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:37.973950 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:37.974758 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:37.975559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:37.976375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:38.190592 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-63468783-5b46-412b-8da6-308b3831e942 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:38.210821 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-63468783-5b46-412b-8da6-308b3831e942 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.367900 Aug 23 22:25:38.211743 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 68/136] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:37 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:38.218221 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-32758f92-d55b-4e94-b098-80897d227ef0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:38.219258 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-32758f92-d55b-4e94-b098-80897d227ef0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:38.226992 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32758f92-d55b-4e94-b098-80897d227ef0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:38.227742 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32758f92-d55b-4e94-b098-80897d227ef0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:38.228396 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32758f92-d55b-4e94-b098-80897d227ef0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:38.229683 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32758f92-d55b-4e94-b098-80897d227ef0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:38.230329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32758f92-d55b-4e94-b098-80897d227ef0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:38.231156 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-32758f92-d55b-4e94-b098-80897d227ef0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:38.394446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:38.411996 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:38.413592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:38.414814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-860832ec-091f-4644-bd42-b119d921eacf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.458947 Aug 23 22:25:38.416898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 69/137] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:37 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:38.422744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-81fe2187-48c1-461f-8ac0-f46256734c8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:38.423364 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-81fe2187-48c1-461f-8ac0-f46256734c8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:38.430140 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81fe2187-48c1-461f-8ac0-f46256734c8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:38.431336 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81fe2187-48c1-461f-8ac0-f46256734c8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:38.431930 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81fe2187-48c1-461f-8ac0-f46256734c8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:38.433287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81fe2187-48c1-461f-8ac0-f46256734c8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:38.434643 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81fe2187-48c1-461f-8ac0-f46256734c8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:38.435526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81fe2187-48c1-461f-8ac0-f46256734c8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:38.469342 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-32758f92-d55b-4e94-b098-80897d227ef0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:38.479658 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-32758f92-d55b-4e94-b098-80897d227ef0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.266419 Aug 23 22:25:38.485001 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 69/138] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:38 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:38.549173 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-fe84b117-0ca4-4331-a9a6-c29fb51255ca req-d63c7f14-f8b2-45d4-970e-95fd337ed9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6155d4-fda2-4409-83f8-0a03e54559bd", "name": "network-vif-plugged", "status": "completed", "tag": "2a039e7d-6c60-4fc6-aeeb-33c9d72e8c2e"}, {"server_uuid": "498d6e2f-6d66-4925-8f7c-eca5b08c1025", "name": "network-vif-plugged", "status": "completed", "tag": "3da5a208-32b6-480a-96ee-d5e85aa6ca75"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:38.564962 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-fe84b117-0ca4-4331-a9a6-c29fb51255ca req-d63c7f14-f8b2-45d4-970e-95fd337ed9b9 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:38.565596 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-fe84b117-0ca4-4331-a9a6-c29fb51255ca req-d63c7f14-f8b2-45d4-970e-95fd337ed9b9 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:38.566317 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-fe84b117-0ca4-4331-a9a6-c29fb51255ca req-d63c7f14-f8b2-45d4-970e-95fd337ed9b9 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:38.588023 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-fe84b117-0ca4-4331-a9a6-c29fb51255ca req-d63c7f14-f8b2-45d4-970e-95fd337ed9b9 service nova] Creating event network-vif-plugged:2a039e7d-6c60-4fc6-aeeb-33c9d72e8c2e for instance 1f6155d4-fda2-4409-83f8-0a03e54559bd on hv-cinder-85032 Aug 23 22:25:38.589323 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-fe84b117-0ca4-4331-a9a6-c29fb51255ca req-d63c7f14-f8b2-45d4-970e-95fd337ed9b9 service nova] Creating event network-vif-plugged:3da5a208-32b6-480a-96ee-d5e85aa6ca75 for instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 on hv-cinder-85032 Aug 23 22:25:38.602161 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-fe84b117-0ca4-4331-a9a6-c29fb51255ca req-d63c7f14-f8b2-45d4-970e-95fd337ed9b9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059195 Aug 23 22:25:38.604001 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 70/139] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:38.734659 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-81fe2187-48c1-461f-8ac0-f46256734c8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:38.743463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-81fe2187-48c1-461f-8ac0-f46256734c8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1366 microversion: 2.1 time: 0.325038 Aug 23 22:25:38.744300 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 70/140] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:38 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:38.849432 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-4ef419a9-176e-40f9-923e-73cb41bd3cb2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:38.850055 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-4ef419a9-176e-40f9-923e-73cb41bd3cb2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:38.857720 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4ef419a9-176e-40f9-923e-73cb41bd3cb2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:38.858203 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4ef419a9-176e-40f9-923e-73cb41bd3cb2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:38.858678 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4ef419a9-176e-40f9-923e-73cb41bd3cb2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:38.859406 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4ef419a9-176e-40f9-923e-73cb41bd3cb2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:38.859858 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4ef419a9-176e-40f9-923e-73cb41bd3cb2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:38.860270 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4ef419a9-176e-40f9-923e-73cb41bd3cb2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:39.101943 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-4ef419a9-176e-40f9-923e-73cb41bd3cb2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:39.111402 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-4ef419a9-176e-40f9-923e-73cb41bd3cb2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1549 microversion: 2.1 time: 0.266374 Aug 23 22:25:39.125802 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 71/141] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:38 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1549 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:39.140943 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9df30e7e-4ded-49ea-8740-f645a9c9704c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:39.142424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9df30e7e-4ded-49ea-8740-f645a9c9704c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:39.148777 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df30e7e-4ded-49ea-8740-f645a9c9704c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:39.149526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df30e7e-4ded-49ea-8740-f645a9c9704c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:39.150287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df30e7e-4ded-49ea-8740-f645a9c9704c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:39.151120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df30e7e-4ded-49ea-8740-f645a9c9704c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:39.151853 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df30e7e-4ded-49ea-8740-f645a9c9704c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:39.152961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df30e7e-4ded-49ea-8740-f645a9c9704c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:39.242856 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-69453c0a-7f08-4e4e-8e60-559116c9aa4c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:39.245731 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-69453c0a-7f08-4e4e-8e60-559116c9aa4c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:39.263118 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69453c0a-7f08-4e4e-8e60-559116c9aa4c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:39.264371 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69453c0a-7f08-4e4e-8e60-559116c9aa4c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:39.265613 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69453c0a-7f08-4e4e-8e60-559116c9aa4c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:39.268917 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69453c0a-7f08-4e4e-8e60-559116c9aa4c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:39.269772 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69453c0a-7f08-4e4e-8e60-559116c9aa4c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:39.270532 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69453c0a-7f08-4e4e-8e60-559116c9aa4c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:39.332105 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9df30e7e-4ded-49ea-8740-f645a9c9704c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.197678 Aug 23 22:25:39.333369 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 71/142] 10.222.0.88 () {58 vars in 1275 bytes} [Tue Aug 23 22:25:39 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:25:39.343989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1293920392", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "networks": [{"uuid": "4af96f9d-d5a7-41bf-8b06-63f6dd287e47"}]}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:39.445262 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] validate_networks() for [('4af96f9d-d5a7-41bf-8b06-63f6dd287e47', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:25:40.122537 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-69453c0a-7f08-4e4e-8e60-559116c9aa4c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:40.141710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-69453c0a-7f08-4e4e-8e60-559116c9aa4c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.910870 Aug 23 22:25:40.143506 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 72/143] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:39 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:40.152070 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:40.158335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:40.172123 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:40.173389 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:40.174279 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:40.179659 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:40.182524 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:40.185014 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:40.593903 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:25:40.599569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:25:40.603081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:25:40.603751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:25:40.604096 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:40.613304 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:25:40.620278 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:40.624058 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:40.625856 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e9deb2cb-aa2e-4c14-b1a3-485a0153f18d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1407 microversion: 2.20 time: 0.477869 Aug 23 22:25:40.633619 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 73/144] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:40 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:25:40.646396 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:40.647237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:40.647934 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:40.649219 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:40.649906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:40.650550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:40.661806 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5c6f0a6d-455c-4956-b83d-1b2ae2d4405c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:40.670519 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-5c6f0a6d-455c-4956-b83d-1b2ae2d4405c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:40.680800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Getting quotas for project e5196561b7ae4adbb110ce06e81401f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:25:40.687730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Getting quotas for user ba49197c9a3446b68bc92c48abf57b37 and project e5196561b7ae4adbb110ce06e81401f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:25:40.692112 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c6f0a6d-455c-4956-b83d-1b2ae2d4405c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:40.692725 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c6f0a6d-455c-4956-b83d-1b2ae2d4405c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:40.693988 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c6f0a6d-455c-4956-b83d-1b2ae2d4405c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:40.695331 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c6f0a6d-455c-4956-b83d-1b2ae2d4405c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:40.695869 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c6f0a6d-455c-4956-b83d-1b2ae2d4405c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:40.696477 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c6f0a6d-455c-4956-b83d-1b2ae2d4405c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:40.720032 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:25:40.728753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:25:40.820038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b38e92ea-0843-4073-82f6-4c4acc980f1c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.485003 Aug 23 22:25:40.820695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 72/145] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:25:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:25:40.830932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5ee49830-446a-4a7d-944e-98c8cf12e940 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:40.832115 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5ee49830-446a-4a7d-944e-98c8cf12e940 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:40.841167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ee49830-446a-4a7d-944e-98c8cf12e940 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:40.841971 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ee49830-446a-4a7d-944e-98c8cf12e940 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:40.844291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ee49830-446a-4a7d-944e-98c8cf12e940 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:40.845426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ee49830-446a-4a7d-944e-98c8cf12e940 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:40.846151 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ee49830-446a-4a7d-944e-98c8cf12e940 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:40.846944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ee49830-446a-4a7d-944e-98c8cf12e940 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:41.094955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5ee49830-446a-4a7d-944e-98c8cf12e940 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:41.103457 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5ee49830-446a-4a7d-944e-98c8cf12e940 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1555 microversion: 2.1 time: 0.281478 Aug 23 22:25:41.104736 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 73/146] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:40 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1555 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:41.110532 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1359b46f-02ed-464d-81ee-ede84a0dd8c1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:41.111361 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1359b46f-02ed-464d-81ee-ede84a0dd8c1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:41.195812 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5c6f0a6d-455c-4956-b83d-1b2ae2d4405c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:41.208681 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1359b46f-02ed-464d-81ee-ede84a0dd8c1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:41.216540 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5c6f0a6d-455c-4956-b83d-1b2ae2d4405c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.580129 Aug 23 22:25:41.221855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1359b46f-02ed-464d-81ee-ede84a0dd8c1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1214 microversion: 2.1 time: 0.114297 Aug 23 22:25:41.221855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 74/147] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:41 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:41.225671 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 74/148] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:40 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:41.231753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4e288e7b-e5db-4355-b137-a7009a9c9546 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:41.235714 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8a7a86ab-f4c4-4b0f-ba93-6f997dbeefa6 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:41.236851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4e288e7b-e5db-4355-b137-a7009a9c9546 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:41.241494 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-8a7a86ab-f4c4-4b0f-ba93-6f997dbeefa6 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:41.243439 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=94 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:41.251541 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8a7a86ab-f4c4-4b0f-ba93-6f997dbeefa6 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:41.252432 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8a7a86ab-f4c4-4b0f-ba93-6f997dbeefa6 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:41.253378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e288e7b-e5db-4355-b137-a7009a9c9546 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:41.253620 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8a7a86ab-f4c4-4b0f-ba93-6f997dbeefa6 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:41.255057 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8a7a86ab-f4c4-4b0f-ba93-6f997dbeefa6 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:41.255250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e288e7b-e5db-4355-b137-a7009a9c9546 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:41.255961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e288e7b-e5db-4355-b137-a7009a9c9546 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:41.256447 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8a7a86ab-f4c4-4b0f-ba93-6f997dbeefa6 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:41.256791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e288e7b-e5db-4355-b137-a7009a9c9546 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:41.257716 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8a7a86ab-f4c4-4b0f-ba93-6f997dbeefa6 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:41.259350 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e288e7b-e5db-4355-b137-a7009a9c9546 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:41.260348 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e288e7b-e5db-4355-b137-a7009a9c9546 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:41.385502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4e288e7b-e5db-4355-b137-a7009a9c9546 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161509 Aug 23 22:25:41.386301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 75/149] 10.222.0.88 () {58 vars in 1275 bytes} [Tue Aug 23 22:25:41 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:41.659020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:41.660418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:41.686767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:41.689911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:41.695116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:41.700551 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:41.702038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:41.703985 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:41.845644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8a7a86ab-f4c4-4b0f-ba93-6f997dbeefa6 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:41.861310 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8a7a86ab-f4c4-4b0f-ba93-6f997dbeefa6 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.631926 Aug 23 22:25:41.861993 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 75/150] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:41 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:41.969275 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-2e46eeda-5928-4ba4-90b4-b759b1c554e1 req-120d9825-dc28-4cea-9f57-434fb6b0d500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd812373-cfc2-4d5e-8230-2e0a72153994", "tag": "614d514f-5113-4d77-8846-ee45da0b972d"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:41.981816 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-2e46eeda-5928-4ba4-90b4-b759b1c554e1 req-120d9825-dc28-4cea-9f57-434fb6b0d500 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:41.982645 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-2e46eeda-5928-4ba4-90b4-b759b1c554e1 req-120d9825-dc28-4cea-9f57-434fb6b0d500 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:41.983227 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-2e46eeda-5928-4ba4-90b4-b759b1c554e1 req-120d9825-dc28-4cea-9f57-434fb6b0d500 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:42.000754 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-2e46eeda-5928-4ba4-90b4-b759b1c554e1 req-120d9825-dc28-4cea-9f57-434fb6b0d500 service nova] Creating event network-changed:614d514f-5113-4d77-8846-ee45da0b972d for instance fd812373-cfc2-4d5e-8230-2e0a72153994 on hv-cinder-85032 Aug 23 22:25:42.007264 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-2e46eeda-5928-4ba4-90b4-b759b1c554e1 req-120d9825-dc28-4cea-9f57-434fb6b0d500 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043341 Aug 23 22:25:42.008334 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 76/151] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:25:42.107028 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:42.109334 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:42.119813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:42.121379 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:42.122846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-16f09815-0a25-4d70-9d1a-5a7bb960fb28 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1598 microversion: 2.20 time: 0.471491 Aug 23 22:25:42.123416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 76/152] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:25:41 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1598 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:25:42.149622 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-55b4b194-6846-45e8-b202-60ae7a8ec7ce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:42.150939 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-55b4b194-6846-45e8-b202-60ae7a8ec7ce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:42.172796 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-55b4b194-6846-45e8-b202-60ae7a8ec7ce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:42.174898 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-55b4b194-6846-45e8-b202-60ae7a8ec7ce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:42.175463 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-55b4b194-6846-45e8-b202-60ae7a8ec7ce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:42.176293 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-55b4b194-6846-45e8-b202-60ae7a8ec7ce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:42.177695 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-55b4b194-6846-45e8-b202-60ae7a8ec7ce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:42.178339 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-55b4b194-6846-45e8-b202-60ae7a8ec7ce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:42.246411 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-854e1e14-be45-44e8-af6d-28815a3968b2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:42.247358 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-854e1e14-be45-44e8-af6d-28815a3968b2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:42.266331 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-854e1e14-be45-44e8-af6d-28815a3968b2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:42.266935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-854e1e14-be45-44e8-af6d-28815a3968b2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:42.267371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-854e1e14-be45-44e8-af6d-28815a3968b2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:42.268071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-854e1e14-be45-44e8-af6d-28815a3968b2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:42.268523 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-854e1e14-be45-44e8-af6d-28815a3968b2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:42.268939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-854e1e14-be45-44e8-af6d-28815a3968b2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:42.596835 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-55b4b194-6846-45e8-b202-60ae7a8ec7ce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.452416 Aug 23 22:25:42.597886 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 77/153] 10.222.0.88 () {60 vars in 1316 bytes} [Tue Aug 23 22:25:42 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-interface => generated 284 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:25:42.609962 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d1b2c2bf-bc8a-4457-bad7-0eb837b3457c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:42.616995 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d1b2c2bf-bc8a-4457-bad7-0eb837b3457c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:42.641792 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2bf-bc8a-4457-bad7-0eb837b3457c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:42.642294 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2bf-bc8a-4457-bad7-0eb837b3457c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:42.649179 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2bf-bc8a-4457-bad7-0eb837b3457c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:42.650352 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2bf-bc8a-4457-bad7-0eb837b3457c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:42.651006 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2bf-bc8a-4457-bad7-0eb837b3457c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:42.651613 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d1b2c2bf-bc8a-4457-bad7-0eb837b3457c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:42.931608 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d1b2c2bf-bc8a-4457-bad7-0eb837b3457c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:42.957197 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d1b2c2bf-bc8a-4457-bad7-0eb837b3457c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1218 microversion: 2.1 time: 0.357050 Aug 23 22:25:42.958026 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 78/154] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:42 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1218 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:42.976254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ccb722ed-a956-4a42-abc6-18676bba42ed tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:42.976912 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ccb722ed-a956-4a42-abc6-18676bba42ed tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:43.002200 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccb722ed-a956-4a42-abc6-18676bba42ed tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:43.003407 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccb722ed-a956-4a42-abc6-18676bba42ed tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:43.004311 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccb722ed-a956-4a42-abc6-18676bba42ed tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:43.005419 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccb722ed-a956-4a42-abc6-18676bba42ed tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:43.006327 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccb722ed-a956-4a42-abc6-18676bba42ed tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:43.007052 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccb722ed-a956-4a42-abc6-18676bba42ed tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:43.316247 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-854e1e14-be45-44e8-af6d-28815a3968b2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:43.327035 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-854e1e14-be45-44e8-af6d-28815a3968b2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 1.091115 Aug 23 22:25:43.330043 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 77/155] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:42 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:43.736832 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ccb722ed-a956-4a42-abc6-18676bba42ed tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:43.753567 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ccb722ed-a956-4a42-abc6-18676bba42ed tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1314 microversion: 2.1 time: 0.793548 Aug 23 22:25:43.754448 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 79/156] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:42 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:43.991049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7bfd3fac-6755-481e-873e-da7f32a2475b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:43.992408 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7bfd3fac-6755-481e-873e-da7f32a2475b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:44.029348 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7bfd3fac-6755-481e-873e-da7f32a2475b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:44.030243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7bfd3fac-6755-481e-873e-da7f32a2475b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:44.037909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7bfd3fac-6755-481e-873e-da7f32a2475b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:44.039310 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7bfd3fac-6755-481e-873e-da7f32a2475b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:44.040192 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7bfd3fac-6755-481e-873e-da7f32a2475b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:44.041214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7bfd3fac-6755-481e-873e-da7f32a2475b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:44.296461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7bfd3fac-6755-481e-873e-da7f32a2475b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:44.325749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7bfd3fac-6755-481e-873e-da7f32a2475b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1266 microversion: 2.1 time: 0.340096 Aug 23 22:25:44.329883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 78/157] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:43 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:44.373392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-76f6438d-7160-42dd-b5b7-58d6c40260e7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:44.375746 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-76f6438d-7160-42dd-b5b7-58d6c40260e7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:44.399279 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-76f6438d-7160-42dd-b5b7-58d6c40260e7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:44.400206 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-76f6438d-7160-42dd-b5b7-58d6c40260e7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:44.400846 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-76f6438d-7160-42dd-b5b7-58d6c40260e7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:44.401726 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-76f6438d-7160-42dd-b5b7-58d6c40260e7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:44.402977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-76f6438d-7160-42dd-b5b7-58d6c40260e7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:44.403720 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-76f6438d-7160-42dd-b5b7-58d6c40260e7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:44.762105 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-f9a0259e-2939-4848-94dc-2518dd3023d9 req-3e46a309-6cfc-4846-a220-09cf45814ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a32adbd-853b-47ce-b461-e82363494a37", "tag": "44698636-efef-43cf-a8ef-8c14ed7f08ab"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:44.783166 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-f9a0259e-2939-4848-94dc-2518dd3023d9 req-3e46a309-6cfc-4846-a220-09cf45814ddc service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:44.783911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-f9a0259e-2939-4848-94dc-2518dd3023d9 req-3e46a309-6cfc-4846-a220-09cf45814ddc service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:44.784569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-f9a0259e-2939-4848-94dc-2518dd3023d9 req-3e46a309-6cfc-4846-a220-09cf45814ddc service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:44.835194 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-f9a0259e-2939-4848-94dc-2518dd3023d9 req-3e46a309-6cfc-4846-a220-09cf45814ddc service nova] Creating event network-changed:44698636-efef-43cf-a8ef-8c14ed7f08ab for instance 8a32adbd-853b-47ce-b461-e82363494a37 on hv-cinder-85032 Aug 23 22:25:44.857472 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-f9a0259e-2939-4848-94dc-2518dd3023d9 req-3e46a309-6cfc-4846-a220-09cf45814ddc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098180 Aug 23 22:25:44.858810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 79/158] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:25:44.870231 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8999e64b-81bb-486a-ac06-1a4c01285da0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:44.872435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8999e64b-81bb-486a-ac06-1a4c01285da0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:44.879704 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8999e64b-81bb-486a-ac06-1a4c01285da0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:44.880653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8999e64b-81bb-486a-ac06-1a4c01285da0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:44.882274 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8999e64b-81bb-486a-ac06-1a4c01285da0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:44.883662 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8999e64b-81bb-486a-ac06-1a4c01285da0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:44.884387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8999e64b-81bb-486a-ac06-1a4c01285da0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:44.885013 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8999e64b-81bb-486a-ac06-1a4c01285da0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:44.947783 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-76f6438d-7160-42dd-b5b7-58d6c40260e7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:44.962796 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-76f6438d-7160-42dd-b5b7-58d6c40260e7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.598511 Aug 23 22:25:44.963427 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 80/159] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:44 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:45.348273 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-db662689-b987-45b4-a136-67130276b0ab req-d74aeeb3-2294-4935-90b0-b4f91cba6f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b697da-19f2-459e-a57e-e386523e4bcf", "tag": "5867c0e1-ac00-4c87-bd75-9ca953635248"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:45.375021 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-db662689-b987-45b4-a136-67130276b0ab req-d74aeeb3-2294-4935-90b0-b4f91cba6f49 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:45.376846 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-db662689-b987-45b4-a136-67130276b0ab req-d74aeeb3-2294-4935-90b0-b4f91cba6f49 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:45.379600 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-db662689-b987-45b4-a136-67130276b0ab req-d74aeeb3-2294-4935-90b0-b4f91cba6f49 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:45.415746 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-db662689-b987-45b4-a136-67130276b0ab req-d74aeeb3-2294-4935-90b0-b4f91cba6f49 service nova] Creating event network-changed:5867c0e1-ac00-4c87-bd75-9ca953635248 for instance 80b697da-19f2-459e-a57e-e386523e4bcf on hv-cinder-85032 Aug 23 22:25:45.428242 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-db662689-b987-45b4-a136-67130276b0ab req-d74aeeb3-2294-4935-90b0-b4f91cba6f49 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084931 Aug 23 22:25:45.432198 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 81/160] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:25:45.454604 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-293c528d-69ad-4fb5-a2a2-6756e03ac8f2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:45.456507 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-293c528d-69ad-4fb5-a2a2-6756e03ac8f2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:45.475417 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-293c528d-69ad-4fb5-a2a2-6756e03ac8f2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:45.476624 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-293c528d-69ad-4fb5-a2a2-6756e03ac8f2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:45.478330 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-293c528d-69ad-4fb5-a2a2-6756e03ac8f2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:45.481739 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-293c528d-69ad-4fb5-a2a2-6756e03ac8f2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:45.483529 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-293c528d-69ad-4fb5-a2a2-6756e03ac8f2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:45.484207 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-293c528d-69ad-4fb5-a2a2-6756e03ac8f2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:45.635377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8999e64b-81bb-486a-ac06-1a4c01285da0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:45.657815 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-293c528d-69ad-4fb5-a2a2-6756e03ac8f2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:45.675553 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-293c528d-69ad-4fb5-a2a2-6756e03ac8f2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1274 microversion: 2.1 time: 0.238608 Aug 23 22:25:45.689082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8999e64b-81bb-486a-ac06-1a4c01285da0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1502 microversion: 2.1 time: 0.822051 Aug 23 22:25:45.689082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 80/161] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:44 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1502 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:45.689918 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 82/162] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:45 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:45.989146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d3f26111-071f-4dca-9f13-6756a159333a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:45.990560 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d3f26111-071f-4dca-9f13-6756a159333a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:45.999156 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d3f26111-071f-4dca-9f13-6756a159333a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:45.999920 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d3f26111-071f-4dca-9f13-6756a159333a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:46.000782 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d3f26111-071f-4dca-9f13-6756a159333a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:46.002484 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d3f26111-071f-4dca-9f13-6756a159333a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:46.003193 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d3f26111-071f-4dca-9f13-6756a159333a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:46.003935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d3f26111-071f-4dca-9f13-6756a159333a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:46.708322 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cbe9da48-da97-436b-8c59-2823d7a0dc09 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:46.710586 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-cbe9da48-da97-436b-8c59-2823d7a0dc09 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:46.736455 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbe9da48-da97-436b-8c59-2823d7a0dc09 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:46.740322 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbe9da48-da97-436b-8c59-2823d7a0dc09 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:46.741826 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbe9da48-da97-436b-8c59-2823d7a0dc09 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:46.744573 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbe9da48-da97-436b-8c59-2823d7a0dc09 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:46.747943 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbe9da48-da97-436b-8c59-2823d7a0dc09 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:46.751267 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbe9da48-da97-436b-8c59-2823d7a0dc09 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:46.899819 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-cbe9da48-da97-436b-8c59-2823d7a0dc09 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:46.914451 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-cbe9da48-da97-436b-8c59-2823d7a0dc09 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1272 microversion: 2.1 time: 0.218385 Aug 23 22:25:46.919346 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 83/163] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:46 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:47.358325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d3f26111-071f-4dca-9f13-6756a159333a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:47.379331 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d3f26111-071f-4dca-9f13-6756a159333a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 1.395000 Aug 23 22:25:47.385383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 81/164] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:45 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:47.809515 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ca46c4ea-a9b6-4e2e-acd2-64578a135475 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "709e242e-9ff8-451d-8258-daa29f802502"}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:47.818039 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ca46c4ea-a9b6-4e2e-acd2-64578a135475 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:47.849299 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca46c4ea-a9b6-4e2e-acd2-64578a135475 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:47.856683 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca46c4ea-a9b6-4e2e-acd2-64578a135475 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:47.860056 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca46c4ea-a9b6-4e2e-acd2-64578a135475 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:47.867264 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca46c4ea-a9b6-4e2e-acd2-64578a135475 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:47.868584 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca46c4ea-a9b6-4e2e-acd2-64578a135475 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:47.869409 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca46c4ea-a9b6-4e2e-acd2-64578a135475 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:47.947486 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-36ebd130-ad1f-4d10-81bb-62f866221e97 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:47.950166 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-36ebd130-ad1f-4d10-81bb-62f866221e97 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:47.964720 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36ebd130-ad1f-4d10-81bb-62f866221e97 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:47.966921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36ebd130-ad1f-4d10-81bb-62f866221e97 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:47.968056 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36ebd130-ad1f-4d10-81bb-62f866221e97 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:47.969778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36ebd130-ad1f-4d10-81bb-62f866221e97 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:47.973129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36ebd130-ad1f-4d10-81bb-62f866221e97 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:47.974310 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36ebd130-ad1f-4d10-81bb-62f866221e97 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:48.139144 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-36ebd130-ad1f-4d10-81bb-62f866221e97 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:48.157889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-36ebd130-ad1f-4d10-81bb-62f866221e97 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1272 microversion: 2.1 time: 0.219331 Aug 23 22:25:48.160304 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 82/165] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:47 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:48.428705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f00e65bd-481d-493b-8dbe-50b1313d8d50 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:48.436528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f00e65bd-481d-493b-8dbe-50b1313d8d50 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:48.459542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f00e65bd-481d-493b-8dbe-50b1313d8d50 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:48.460687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f00e65bd-481d-493b-8dbe-50b1313d8d50 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:48.461424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f00e65bd-481d-493b-8dbe-50b1313d8d50 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:48.462772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f00e65bd-481d-493b-8dbe-50b1313d8d50 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:48.463566 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f00e65bd-481d-493b-8dbe-50b1313d8d50 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:48.464579 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f00e65bd-481d-493b-8dbe-50b1313d8d50 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:48.617583 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ca46c4ea-a9b6-4e2e-acd2-64578a135475 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "POST /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.822286 Aug 23 22:25:48.619683 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 84/166] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:25:47 2022] POST /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:48.981356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f00e65bd-481d-493b-8dbe-50b1313d8d50 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:49.006847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f00e65bd-481d-493b-8dbe-50b1313d8d50 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.582818 Aug 23 22:25:49.026199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 83/167] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:48 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:49.183889 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-9650a36d-24c7-443b-bf01-c29791b410c7 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:49.185652 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9650a36d-24c7-443b-bf01-c29791b410c7 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:49.206249 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9650a36d-24c7-443b-bf01-c29791b410c7 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:49.212488 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9650a36d-24c7-443b-bf01-c29791b410c7 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:49.213502 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9650a36d-24c7-443b-bf01-c29791b410c7 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:49.218128 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9650a36d-24c7-443b-bf01-c29791b410c7 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:49.221567 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9650a36d-24c7-443b-bf01-c29791b410c7 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:49.222904 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9650a36d-24c7-443b-bf01-c29791b410c7 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:49.242763 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:49.498757 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9650a36d-24c7-443b-bf01-c29791b410c7 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:49.510263 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-9650a36d-24c7-443b-bf01-c29791b410c7 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.332726 Aug 23 22:25:49.511228 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 85/168] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:49 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:49.941095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-0bf6a36c-02f9-4879-be0b-d39f3a7f77fe req-7345eb75-b085-4652-b9ba-7062d212866c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d41cb922-8ceb-4d97-991a-7a3f88002bd1", "tag": "86d62334-8569-42b8-a145-9361fc05ffcf"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:49.964958 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0bf6a36c-02f9-4879-be0b-d39f3a7f77fe req-7345eb75-b085-4652-b9ba-7062d212866c service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:49.966426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0bf6a36c-02f9-4879-be0b-d39f3a7f77fe req-7345eb75-b085-4652-b9ba-7062d212866c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:49.966426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0bf6a36c-02f9-4879-be0b-d39f3a7f77fe req-7345eb75-b085-4652-b9ba-7062d212866c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:49.984182 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-0bf6a36c-02f9-4879-be0b-d39f3a7f77fe req-7345eb75-b085-4652-b9ba-7062d212866c service nova] Creating event network-changed:86d62334-8569-42b8-a145-9361fc05ffcf for instance d41cb922-8ceb-4d97-991a-7a3f88002bd1 on hv-cinder-85032 Aug 23 22:25:49.989523 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-0bf6a36c-02f9-4879-be0b-d39f3a7f77fe req-7345eb75-b085-4652-b9ba-7062d212866c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059824 Aug 23 22:25:49.990514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 84/169] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:50.041103 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e5b59f24-0c77-45a3-b5a3-866bfd51bea3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:50.041764 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e5b59f24-0c77-45a3-b5a3-866bfd51bea3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:50.050490 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5b59f24-0c77-45a3-b5a3-866bfd51bea3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:50.050997 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5b59f24-0c77-45a3-b5a3-866bfd51bea3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:50.051507 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5b59f24-0c77-45a3-b5a3-866bfd51bea3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:50.052372 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5b59f24-0c77-45a3-b5a3-866bfd51bea3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:50.052926 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5b59f24-0c77-45a3-b5a3-866bfd51bea3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:50.053398 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5b59f24-0c77-45a3-b5a3-866bfd51bea3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:50.279516 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e5b59f24-0c77-45a3-b5a3-866bfd51bea3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:50.311348 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e5b59f24-0c77-45a3-b5a3-866bfd51bea3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.274951 Aug 23 22:25:50.313130 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 86/170] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:50 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:50.541803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-35a6786c-4dcb-47c4-9434-4252e56a5ad2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:50.543444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-35a6786c-4dcb-47c4-9434-4252e56a5ad2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:50.554879 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35a6786c-4dcb-47c4-9434-4252e56a5ad2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:50.556096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35a6786c-4dcb-47c4-9434-4252e56a5ad2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:50.557216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35a6786c-4dcb-47c4-9434-4252e56a5ad2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:50.559312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35a6786c-4dcb-47c4-9434-4252e56a5ad2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:50.560470 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35a6786c-4dcb-47c4-9434-4252e56a5ad2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:50.561449 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35a6786c-4dcb-47c4-9434-4252e56a5ad2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:50.667349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:50.938903 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-35a6786c-4dcb-47c4-9434-4252e56a5ad2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:50.957329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-35a6786c-4dcb-47c4-9434-4252e56a5ad2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.421767 Aug 23 22:25:50.959083 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 85/171] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:50 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:51.339093 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b8187512-ff1a-4252-8c5a-46e2e0969cb9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:51.339968 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-b8187512-ff1a-4252-8c5a-46e2e0969cb9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:51.347028 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b8187512-ff1a-4252-8c5a-46e2e0969cb9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:51.347671 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b8187512-ff1a-4252-8c5a-46e2e0969cb9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:51.348162 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b8187512-ff1a-4252-8c5a-46e2e0969cb9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:51.348967 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b8187512-ff1a-4252-8c5a-46e2e0969cb9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:51.349695 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b8187512-ff1a-4252-8c5a-46e2e0969cb9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:51.350122 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b8187512-ff1a-4252-8c5a-46e2e0969cb9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:51.528713 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-b8187512-ff1a-4252-8c5a-46e2e0969cb9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:51.538978 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-b8187512-ff1a-4252-8c5a-46e2e0969cb9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.203912 Aug 23 22:25:51.539894 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 87/172] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:51 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:51.997966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d4109fba-a277-4934-9d3e-f5074ff3e827 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:51.998657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d4109fba-a277-4934-9d3e-f5074ff3e827 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:52.000396 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=8 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:52.006141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d4109fba-a277-4934-9d3e-f5074ff3e827 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:52.006633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d4109fba-a277-4934-9d3e-f5074ff3e827 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:52.007040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d4109fba-a277-4934-9d3e-f5074ff3e827 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:52.007741 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d4109fba-a277-4934-9d3e-f5074ff3e827 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:52.008182 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d4109fba-a277-4934-9d3e-f5074ff3e827 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:52.008593 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d4109fba-a277-4934-9d3e-f5074ff3e827 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:52.188262 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d4109fba-a277-4934-9d3e-f5074ff3e827 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:52.198096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d4109fba-a277-4934-9d3e-f5074ff3e827 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.204865 Aug 23 22:25:52.199107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 86/173] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:51 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:52.561876 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cfe11cea-6c7a-48f4-8643-b000b81d6cd3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:52.562879 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-cfe11cea-6c7a-48f4-8643-b000b81d6cd3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:52.570195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfe11cea-6c7a-48f4-8643-b000b81d6cd3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:52.570794 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfe11cea-6c7a-48f4-8643-b000b81d6cd3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:52.571331 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfe11cea-6c7a-48f4-8643-b000b81d6cd3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:52.572044 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfe11cea-6c7a-48f4-8643-b000b81d6cd3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:52.572437 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfe11cea-6c7a-48f4-8643-b000b81d6cd3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:52.572864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfe11cea-6c7a-48f4-8643-b000b81d6cd3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:52.731238 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-cfe11cea-6c7a-48f4-8643-b000b81d6cd3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:52.740105 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-cfe11cea-6c7a-48f4-8643-b000b81d6cd3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.183857 Aug 23 22:25:52.741145 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 88/174] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:52 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:53.225752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2fb12605-f7e6-4d73-9676-72feb8460fb6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:53.226455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2fb12605-f7e6-4d73-9676-72feb8460fb6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:53.240870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fb12605-f7e6-4d73-9676-72feb8460fb6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:53.241472 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fb12605-f7e6-4d73-9676-72feb8460fb6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:53.244151 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fb12605-f7e6-4d73-9676-72feb8460fb6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:53.245233 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fb12605-f7e6-4d73-9676-72feb8460fb6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:53.245897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fb12605-f7e6-4d73-9676-72feb8460fb6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:53.246771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fb12605-f7e6-4d73-9676-72feb8460fb6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:53.441649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2fb12605-f7e6-4d73-9676-72feb8460fb6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:53.454826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2fb12605-f7e6-4d73-9676-72feb8460fb6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.233799 Aug 23 22:25:53.456305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 87/175] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:53 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:53.764888 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-460f46c4-d3eb-43bc-a57c-d6760d4ffd1a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:53.765719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-460f46c4-d3eb-43bc-a57c-d6760d4ffd1a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:53.776486 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f46c4-d3eb-43bc-a57c-d6760d4ffd1a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:53.778078 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f46c4-d3eb-43bc-a57c-d6760d4ffd1a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:53.778674 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f46c4-d3eb-43bc-a57c-d6760d4ffd1a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:53.779829 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f46c4-d3eb-43bc-a57c-d6760d4ffd1a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:53.780577 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f46c4-d3eb-43bc-a57c-d6760d4ffd1a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:53.781084 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-460f46c4-d3eb-43bc-a57c-d6760d4ffd1a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:53.966084 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-460f46c4-d3eb-43bc-a57c-d6760d4ffd1a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:53.978193 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-460f46c4-d3eb-43bc-a57c-d6760d4ffd1a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.218215 Aug 23 22:25:53.978953 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 89/176] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:53 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:54.477502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-960fd7d7-29d6-468f-98fe-d1f2c9833686 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:54.478351 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-960fd7d7-29d6-468f-98fe-d1f2c9833686 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:54.485045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-960fd7d7-29d6-468f-98fe-d1f2c9833686 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:54.485550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-960fd7d7-29d6-468f-98fe-d1f2c9833686 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:54.485974 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-960fd7d7-29d6-468f-98fe-d1f2c9833686 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:54.486670 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-960fd7d7-29d6-468f-98fe-d1f2c9833686 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:54.487293 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-960fd7d7-29d6-468f-98fe-d1f2c9833686 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:54.487573 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-960fd7d7-29d6-468f-98fe-d1f2c9833686 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:54.661954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-960fd7d7-29d6-468f-98fe-d1f2c9833686 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:54.673707 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-960fd7d7-29d6-468f-98fe-d1f2c9833686 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.199923 Aug 23 22:25:54.674560 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 88/177] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:54 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:55.003709 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3c5fe378-6ecf-41a8-9668-88af7a86a9ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:55.004708 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3c5fe378-6ecf-41a8-9668-88af7a86a9ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:55.013920 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3c5fe378-6ecf-41a8-9668-88af7a86a9ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:55.014460 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3c5fe378-6ecf-41a8-9668-88af7a86a9ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:55.014988 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3c5fe378-6ecf-41a8-9668-88af7a86a9ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:55.015829 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3c5fe378-6ecf-41a8-9668-88af7a86a9ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:55.016358 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3c5fe378-6ecf-41a8-9668-88af7a86a9ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:55.016859 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3c5fe378-6ecf-41a8-9668-88af7a86a9ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:55.191245 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3c5fe378-6ecf-41a8-9668-88af7a86a9ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:55.200224 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3c5fe378-6ecf-41a8-9668-88af7a86a9ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.203610 Aug 23 22:25:55.200912 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 90/178] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:54 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:55.695568 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-96302c78-e73a-4139-b87e-2d000ad43886 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:55.696210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-96302c78-e73a-4139-b87e-2d000ad43886 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:55.702764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96302c78-e73a-4139-b87e-2d000ad43886 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:55.703238 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96302c78-e73a-4139-b87e-2d000ad43886 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:55.703666 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96302c78-e73a-4139-b87e-2d000ad43886 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:55.704359 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96302c78-e73a-4139-b87e-2d000ad43886 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:55.704805 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96302c78-e73a-4139-b87e-2d000ad43886 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:55.705244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-96302c78-e73a-4139-b87e-2d000ad43886 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:55.868926 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-96302c78-e73a-4139-b87e-2d000ad43886 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:55.883462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-96302c78-e73a-4139-b87e-2d000ad43886 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.191140 Aug 23 22:25:55.887295 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 89/179] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:55 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:56.223468 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e2190112-f319-453c-bb8b-509d41624149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:56.225235 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e2190112-f319-453c-bb8b-509d41624149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:56.234807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e2190112-f319-453c-bb8b-509d41624149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:56.235630 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e2190112-f319-453c-bb8b-509d41624149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:56.236392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e2190112-f319-453c-bb8b-509d41624149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:56.238088 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e2190112-f319-453c-bb8b-509d41624149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:56.238734 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e2190112-f319-453c-bb8b-509d41624149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:56.239544 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e2190112-f319-453c-bb8b-509d41624149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:56.396181 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e2190112-f319-453c-bb8b-509d41624149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:56.406393 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e2190112-f319-453c-bb8b-509d41624149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.187565 Aug 23 22:25:56.406978 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 91/180] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:56 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:56.919484 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-31bcf88d-3567-4698-905f-013d883441e4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:56.920104 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-31bcf88d-3567-4698-905f-013d883441e4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:56.927759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31bcf88d-3567-4698-905f-013d883441e4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:56.928501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31bcf88d-3567-4698-905f-013d883441e4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:56.930695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31bcf88d-3567-4698-905f-013d883441e4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:56.930961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31bcf88d-3567-4698-905f-013d883441e4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:56.931430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31bcf88d-3567-4698-905f-013d883441e4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:56.932118 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31bcf88d-3567-4698-905f-013d883441e4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:57.127006 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-31bcf88d-3567-4698-905f-013d883441e4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:57.142949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-31bcf88d-3567-4698-905f-013d883441e4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.225186 Aug 23 22:25:57.142949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 90/181] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:56 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:57.431165 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-1e90a6e0-9191-46a7-8593-c5fb948ada13 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:57.432604 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-1e90a6e0-9191-46a7-8593-c5fb948ada13 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:57.444365 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1e90a6e0-9191-46a7-8593-c5fb948ada13 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:57.444885 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1e90a6e0-9191-46a7-8593-c5fb948ada13 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:57.446232 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1e90a6e0-9191-46a7-8593-c5fb948ada13 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:57.448135 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1e90a6e0-9191-46a7-8593-c5fb948ada13 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:57.449846 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1e90a6e0-9191-46a7-8593-c5fb948ada13 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:57.450538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1e90a6e0-9191-46a7-8593-c5fb948ada13 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:57.708640 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-1e90a6e0-9191-46a7-8593-c5fb948ada13 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:57.724060 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-1e90a6e0-9191-46a7-8593-c5fb948ada13 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.299403 Aug 23 22:25:57.726112 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 92/182] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:57 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:57.804180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-3ee64c30-083f-4bdb-8932-b1073fb155a4 req-a973e482-af90-4ba1-b086-0fb4564af31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41cb922-8ceb-4d97-991a-7a3f88002bd1", "name": "network-vif-plugged", "status": "completed", "tag": "86d62334-8569-42b8-a145-9361fc05ffcf"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:25:57.841553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3ee64c30-083f-4bdb-8932-b1073fb155a4 req-a973e482-af90-4ba1-b086-0fb4564af31d service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:57.844791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3ee64c30-083f-4bdb-8932-b1073fb155a4 req-a973e482-af90-4ba1-b086-0fb4564af31d service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:57.847937 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3ee64c30-083f-4bdb-8932-b1073fb155a4 req-a973e482-af90-4ba1-b086-0fb4564af31d service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:57.874241 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-3ee64c30-083f-4bdb-8932-b1073fb155a4 req-a973e482-af90-4ba1-b086-0fb4564af31d service nova] Creating event network-vif-plugged:86d62334-8569-42b8-a145-9361fc05ffcf for instance d41cb922-8ceb-4d97-991a-7a3f88002bd1 on hv-cinder-85032 Aug 23 22:25:57.884660 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-3ee64c30-083f-4bdb-8932-b1073fb155a4 req-a973e482-af90-4ba1-b086-0fb4564af31d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100241 Aug 23 22:25:57.886756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 91/183] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:25:58.170526 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-acbd0ec6-20c5-4148-9841-64ceeef34499 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:58.170526 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-acbd0ec6-20c5-4148-9841-64ceeef34499 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:58.178185 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-acbd0ec6-20c5-4148-9841-64ceeef34499 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:58.178671 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-acbd0ec6-20c5-4148-9841-64ceeef34499 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:58.179301 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-acbd0ec6-20c5-4148-9841-64ceeef34499 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:58.180005 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-acbd0ec6-20c5-4148-9841-64ceeef34499 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:58.180545 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-acbd0ec6-20c5-4148-9841-64ceeef34499 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:58.181636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-acbd0ec6-20c5-4148-9841-64ceeef34499 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:58.459236 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-acbd0ec6-20c5-4148-9841-64ceeef34499 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:58.474459 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-acbd0ec6-20c5-4148-9841-64ceeef34499 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.310541 Aug 23 22:25:58.475644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 93/184] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:58 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:58.751713 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-68925241-3b8b-4d3d-ab6e-294420053d8d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:58.752422 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-68925241-3b8b-4d3d-ab6e-294420053d8d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:58.760364 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-68925241-3b8b-4d3d-ab6e-294420053d8d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:58.773767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-68925241-3b8b-4d3d-ab6e-294420053d8d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:58.774807 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-68925241-3b8b-4d3d-ab6e-294420053d8d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:58.776111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-68925241-3b8b-4d3d-ab6e-294420053d8d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:58.776780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-68925241-3b8b-4d3d-ab6e-294420053d8d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:58.777972 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-68925241-3b8b-4d3d-ab6e-294420053d8d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:58.784375 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-f55e50ea-7c64-4a80-97e0-686793731fa8 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:58.784924 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-f55e50ea-7c64-4a80-97e0-686793731fa8 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:58.802380 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f55e50ea-7c64-4a80-97e0-686793731fa8 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:58.803124 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f55e50ea-7c64-4a80-97e0-686793731fa8 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:58.803893 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f55e50ea-7c64-4a80-97e0-686793731fa8 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:58.804897 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f55e50ea-7c64-4a80-97e0-686793731fa8 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:58.805702 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f55e50ea-7c64-4a80-97e0-686793731fa8 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:58.806323 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f55e50ea-7c64-4a80-97e0-686793731fa8 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:58.844475 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-f55e50ea-7c64-4a80-97e0-686793731fa8 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Going to try to terminate instance {{(pid=120855) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:25:58.992227 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-f55e50ea-7c64-4a80-97e0-686793731fa8 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 204 len: 0 microversion: 2.1 time: 0.210747 Aug 23 22:25:58.998065 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 94/185] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:25:58 2022] DELETE /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:25:59.006131 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-fd33973c-b476-4a41-99d3-34565dcb14e4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:59.006852 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-fd33973c-b476-4a41-99d3-34565dcb14e4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:59.016902 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fd33973c-b476-4a41-99d3-34565dcb14e4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:59.017446 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fd33973c-b476-4a41-99d3-34565dcb14e4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:59.018169 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fd33973c-b476-4a41-99d3-34565dcb14e4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:59.018901 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fd33973c-b476-4a41-99d3-34565dcb14e4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:59.019696 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fd33973c-b476-4a41-99d3-34565dcb14e4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:59.020127 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fd33973c-b476-4a41-99d3-34565dcb14e4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:59.075554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-68925241-3b8b-4d3d-ab6e-294420053d8d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:59.104259 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-68925241-3b8b-4d3d-ab6e-294420053d8d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.358246 Aug 23 22:25:59.109447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 92/186] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:58 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:25:59.192321 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-fd33973c-b476-4a41-99d3-34565dcb14e4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:59.201859 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-fd33973c-b476-4a41-99d3-34565dcb14e4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1554 microversion: 2.1 time: 0.201465 Aug 23 22:25:59.202586 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 95/187] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:58 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:25:59.503084 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d8057f90-30c6-4756-a466-d227ee0b2a7c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:25:59.504644 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d8057f90-30c6-4756-a466-d227ee0b2a7c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:25:59.513287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8057f90-30c6-4756-a466-d227ee0b2a7c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:59.513987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8057f90-30c6-4756-a466-d227ee0b2a7c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:59.514564 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8057f90-30c6-4756-a466-d227ee0b2a7c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:59.515465 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8057f90-30c6-4756-a466-d227ee0b2a7c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:25:59.516094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8057f90-30c6-4756-a466-d227ee0b2a7c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:25:59.516882 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8057f90-30c6-4756-a466-d227ee0b2a7c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:25:59.705254 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d8057f90-30c6-4756-a466-d227ee0b2a7c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:25:59.716516 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d8057f90-30c6-4756-a466-d227ee0b2a7c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.219965 Aug 23 22:25:59.717133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 93/188] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:25:59 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:00.143832 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-46366570-ab92-4cff-9b6a-512b5c50bea5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:00.144444 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-46366570-ab92-4cff-9b6a-512b5c50bea5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:00.152599 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46366570-ab92-4cff-9b6a-512b5c50bea5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:00.153206 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46366570-ab92-4cff-9b6a-512b5c50bea5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:00.153693 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46366570-ab92-4cff-9b6a-512b5c50bea5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:00.154519 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46366570-ab92-4cff-9b6a-512b5c50bea5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:00.155017 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46366570-ab92-4cff-9b6a-512b5c50bea5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:00.155545 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-46366570-ab92-4cff-9b6a-512b5c50bea5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:00.226467 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-435209d8-4719-4bcd-9b09-afbf7f5b0e5e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:00.227153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-435209d8-4719-4bcd-9b09-afbf7f5b0e5e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:00.230377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:00.239982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-435209d8-4719-4bcd-9b09-afbf7f5b0e5e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:00.241303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-435209d8-4719-4bcd-9b09-afbf7f5b0e5e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:00.242314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-435209d8-4719-4bcd-9b09-afbf7f5b0e5e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:00.243803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-435209d8-4719-4bcd-9b09-afbf7f5b0e5e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:00.245620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-435209d8-4719-4bcd-9b09-afbf7f5b0e5e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:00.246911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-435209d8-4719-4bcd-9b09-afbf7f5b0e5e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:00.330182 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-46366570-ab92-4cff-9b6a-512b5c50bea5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:00.343849 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-46366570-ab92-4cff-9b6a-512b5c50bea5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.202190 Aug 23 22:26:00.344648 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 96/189] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:00 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:00.474567 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-435209d8-4719-4bcd-9b09-afbf7f5b0e5e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:00.490136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-435209d8-4719-4bcd-9b09-afbf7f5b0e5e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1554 microversion: 2.1 time: 0.268334 Aug 23 22:26:00.491417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 94/190] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:00 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:00.738655 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-13c81992-5ec6-4e06-bc1f-99b8fae79a2d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:00.739684 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-13c81992-5ec6-4e06-bc1f-99b8fae79a2d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:00.748311 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-13c81992-5ec6-4e06-bc1f-99b8fae79a2d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:00.748911 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-13c81992-5ec6-4e06-bc1f-99b8fae79a2d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:00.749649 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-13c81992-5ec6-4e06-bc1f-99b8fae79a2d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:00.750696 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-13c81992-5ec6-4e06-bc1f-99b8fae79a2d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:00.751195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-13c81992-5ec6-4e06-bc1f-99b8fae79a2d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:00.752119 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-13c81992-5ec6-4e06-bc1f-99b8fae79a2d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:00.922560 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-13c81992-5ec6-4e06-bc1f-99b8fae79a2d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:00.931235 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-13c81992-5ec6-4e06-bc1f-99b8fae79a2d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.196652 Aug 23 22:26:00.932092 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 97/191] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:00 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:01.379347 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0efa3afb-49eb-4fdd-93bb-6cef32059ff6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:01.380138 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0efa3afb-49eb-4fdd-93bb-6cef32059ff6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:01.388475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0efa3afb-49eb-4fdd-93bb-6cef32059ff6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:01.388975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0efa3afb-49eb-4fdd-93bb-6cef32059ff6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:01.389460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0efa3afb-49eb-4fdd-93bb-6cef32059ff6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:01.390209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0efa3afb-49eb-4fdd-93bb-6cef32059ff6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:01.390779 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0efa3afb-49eb-4fdd-93bb-6cef32059ff6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:01.391222 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0efa3afb-49eb-4fdd-93bb-6cef32059ff6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:01.413204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=100 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:01.517655 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ece67303-d0f1-4626-8f09-70ce39c5e3b3 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:01.518704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ece67303-d0f1-4626-8f09-70ce39c5e3b3 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:01.536866 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ece67303-d0f1-4626-8f09-70ce39c5e3b3 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:01.537778 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ece67303-d0f1-4626-8f09-70ce39c5e3b3 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:01.538426 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ece67303-d0f1-4626-8f09-70ce39c5e3b3 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:01.539697 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ece67303-d0f1-4626-8f09-70ce39c5e3b3 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:01.540534 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ece67303-d0f1-4626-8f09-70ce39c5e3b3 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:01.541392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ece67303-d0f1-4626-8f09-70ce39c5e3b3 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:01.592703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0efa3afb-49eb-4fdd-93bb-6cef32059ff6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:01.603517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0efa3afb-49eb-4fdd-93bb-6cef32059ff6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.228204 Aug 23 22:26:01.604213 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 95/192] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:01 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:01.731165 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ece67303-d0f1-4626-8f09-70ce39c5e3b3 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:01.744388 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ece67303-d0f1-4626-8f09-70ce39c5e3b3 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1554 microversion: 2.1 time: 0.234793 Aug 23 22:26:01.745499 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 98/193] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:01 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:01.958328 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-da1ee2e8-2d3f-4a71-82cc-cf870423203b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:01.959390 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-da1ee2e8-2d3f-4a71-82cc-cf870423203b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:01.969923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1ee2e8-2d3f-4a71-82cc-cf870423203b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:01.970475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1ee2e8-2d3f-4a71-82cc-cf870423203b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:01.971101 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1ee2e8-2d3f-4a71-82cc-cf870423203b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:01.972264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1ee2e8-2d3f-4a71-82cc-cf870423203b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:01.973017 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1ee2e8-2d3f-4a71-82cc-cf870423203b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:01.973755 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1ee2e8-2d3f-4a71-82cc-cf870423203b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:02.157778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-da1ee2e8-2d3f-4a71-82cc-cf870423203b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:02.166678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-da1ee2e8-2d3f-4a71-82cc-cf870423203b tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.215840 Aug 23 22:26:02.168019 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 96/194] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:01 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:02.627242 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-da4bdd75-b069-4168-914a-58cd2f64a176 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:02.627798 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-da4bdd75-b069-4168-914a-58cd2f64a176 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:02.634674 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-da4bdd75-b069-4168-914a-58cd2f64a176 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:02.635164 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-da4bdd75-b069-4168-914a-58cd2f64a176 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:02.635636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-da4bdd75-b069-4168-914a-58cd2f64a176 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:02.637116 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-da4bdd75-b069-4168-914a-58cd2f64a176 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:02.637617 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-da4bdd75-b069-4168-914a-58cd2f64a176 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:02.638141 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-da4bdd75-b069-4168-914a-58cd2f64a176 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:02.772542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d8610c00-aeba-44c5-bd97-b623b5ccd6d7 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:02.773678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d8610c00-aeba-44c5-bd97-b623b5ccd6d7 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:02.782667 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8610c00-aeba-44c5-bd97-b623b5ccd6d7 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:02.783473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8610c00-aeba-44c5-bd97-b623b5ccd6d7 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:02.783913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8610c00-aeba-44c5-bd97-b623b5ccd6d7 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:02.785163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8610c00-aeba-44c5-bd97-b623b5ccd6d7 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:02.785981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8610c00-aeba-44c5-bd97-b623b5ccd6d7 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:02.786928 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8610c00-aeba-44c5-bd97-b623b5ccd6d7 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:02.800551 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-da4bdd75-b069-4168-914a-58cd2f64a176 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:02.814819 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-da4bdd75-b069-4168-914a-58cd2f64a176 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.191160 Aug 23 22:26:02.816056 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 99/195] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:02 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:02.960182 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d8610c00-aeba-44c5-bd97-b623b5ccd6d7 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:02.969955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d8610c00-aeba-44c5-bd97-b623b5ccd6d7 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1554 microversion: 2.1 time: 0.206560 Aug 23 22:26:02.970547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 97/196] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:02 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:03.189634 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-034f7260-73f6-4a02-a36b-3a7054992519 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:03.190410 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-034f7260-73f6-4a02-a36b-3a7054992519 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:03.197315 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-034f7260-73f6-4a02-a36b-3a7054992519 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:03.197800 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-034f7260-73f6-4a02-a36b-3a7054992519 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:03.198232 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-034f7260-73f6-4a02-a36b-3a7054992519 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:03.199531 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-034f7260-73f6-4a02-a36b-3a7054992519 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:03.200101 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-034f7260-73f6-4a02-a36b-3a7054992519 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:03.200595 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-034f7260-73f6-4a02-a36b-3a7054992519 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:03.205555 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:03.382577 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-034f7260-73f6-4a02-a36b-3a7054992519 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:03.392630 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-034f7260-73f6-4a02-a36b-3a7054992519 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.207139 Aug 23 22:26:03.393155 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 100/197] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:03 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:03.846531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-04f4d733-dd3e-46b7-a8e7-ae419b1b3029 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:03.847284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-04f4d733-dd3e-46b7-a8e7-ae419b1b3029 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:03.853952 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-04f4d733-dd3e-46b7-a8e7-ae419b1b3029 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:03.854507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-04f4d733-dd3e-46b7-a8e7-ae419b1b3029 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:03.855103 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-04f4d733-dd3e-46b7-a8e7-ae419b1b3029 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:03.856220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-04f4d733-dd3e-46b7-a8e7-ae419b1b3029 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:03.856682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-04f4d733-dd3e-46b7-a8e7-ae419b1b3029 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:03.857137 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-04f4d733-dd3e-46b7-a8e7-ae419b1b3029 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:03.993662 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-19aedac8-38d0-418f-8811-88686f487c99 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:03.994460 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-19aedac8-38d0-418f-8811-88686f487c99 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:04.003370 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19aedac8-38d0-418f-8811-88686f487c99 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:04.003889 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19aedac8-38d0-418f-8811-88686f487c99 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:04.004336 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19aedac8-38d0-418f-8811-88686f487c99 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:04.005184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19aedac8-38d0-418f-8811-88686f487c99 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:04.005650 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19aedac8-38d0-418f-8811-88686f487c99 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:04.006081 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19aedac8-38d0-418f-8811-88686f487c99 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:04.028597 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-04f4d733-dd3e-46b7-a8e7-ae419b1b3029 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:04.038803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-04f4d733-dd3e-46b7-a8e7-ae419b1b3029 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.196020 Aug 23 22:26:04.039581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 98/198] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:03 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:04.174979 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-19aedac8-38d0-418f-8811-88686f487c99 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:04.191316 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-19aedac8-38d0-418f-8811-88686f487c99 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1554 microversion: 2.1 time: 0.201715 Aug 23 22:26:04.192363 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 101/199] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:03 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:04.414661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a1931627-2531-48ed-b4de-de5a5590dac0 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:04.415303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a1931627-2531-48ed-b4de-de5a5590dac0 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:04.423022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1931627-2531-48ed-b4de-de5a5590dac0 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:04.423513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1931627-2531-48ed-b4de-de5a5590dac0 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:04.423941 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1931627-2531-48ed-b4de-de5a5590dac0 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:04.424638 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1931627-2531-48ed-b4de-de5a5590dac0 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:04.425192 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1931627-2531-48ed-b4de-de5a5590dac0 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:04.425618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1931627-2531-48ed-b4de-de5a5590dac0 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:04.584795 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a1931627-2531-48ed-b4de-de5a5590dac0 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:04.596797 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a1931627-2531-48ed-b4de-de5a5590dac0 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.185918 Aug 23 22:26:04.597457 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 99/200] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:04 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:05.068070 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-68ce800b-e469-46c2-bc47-e45754eb42a6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:05.069293 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-68ce800b-e469-46c2-bc47-e45754eb42a6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:05.079702 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-68ce800b-e469-46c2-bc47-e45754eb42a6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:05.080198 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-68ce800b-e469-46c2-bc47-e45754eb42a6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:05.080631 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-68ce800b-e469-46c2-bc47-e45754eb42a6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:05.081372 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-68ce800b-e469-46c2-bc47-e45754eb42a6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:05.081831 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-68ce800b-e469-46c2-bc47-e45754eb42a6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:05.082252 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-68ce800b-e469-46c2-bc47-e45754eb42a6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:05.227577 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8d15ae6b-412e-4b0c-ba0d-585549208a6f tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:05.228618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8d15ae6b-412e-4b0c-ba0d-585549208a6f tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:05.236537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d15ae6b-412e-4b0c-ba0d-585549208a6f tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:05.237247 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d15ae6b-412e-4b0c-ba0d-585549208a6f tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:05.237901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d15ae6b-412e-4b0c-ba0d-585549208a6f tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:05.238933 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d15ae6b-412e-4b0c-ba0d-585549208a6f tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:05.239741 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d15ae6b-412e-4b0c-ba0d-585549208a6f tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:05.240623 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d15ae6b-412e-4b0c-ba0d-585549208a6f tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:05.251396 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-68ce800b-e469-46c2-bc47-e45754eb42a6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:05.265426 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-68ce800b-e469-46c2-bc47-e45754eb42a6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.205195 Aug 23 22:26:05.277247 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 102/201] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:05 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:05.443428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8d15ae6b-412e-4b0c-ba0d-585549208a6f tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:05.452986 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8d15ae6b-412e-4b0c-ba0d-585549208a6f tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1554 microversion: 2.1 time: 0.230218 Aug 23 22:26:05.454245 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 100/202] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:05 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1554 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:05.619027 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-fc558ac6-88f8-44ee-908d-b85802dcb5f6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:05.619736 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-fc558ac6-88f8-44ee-908d-b85802dcb5f6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:05.628133 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc558ac6-88f8-44ee-908d-b85802dcb5f6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:05.628633 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc558ac6-88f8-44ee-908d-b85802dcb5f6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:05.629097 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc558ac6-88f8-44ee-908d-b85802dcb5f6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:05.629799 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc558ac6-88f8-44ee-908d-b85802dcb5f6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:05.630254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc558ac6-88f8-44ee-908d-b85802dcb5f6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:05.630674 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc558ac6-88f8-44ee-908d-b85802dcb5f6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:06.069894 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-fc558ac6-88f8-44ee-908d-b85802dcb5f6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:06.081343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-fc558ac6-88f8-44ee-908d-b85802dcb5f6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1314 microversion: 2.1 time: 0.466580 Aug 23 22:26:06.081943 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 103/203] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:05 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:06.289538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d9cd9703-99ee-4ed4-8c2d-20b401c4a3e1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:06.290136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d9cd9703-99ee-4ed4-8c2d-20b401c4a3e1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:06.296876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9cd9703-99ee-4ed4-8c2d-20b401c4a3e1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:06.297349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9cd9703-99ee-4ed4-8c2d-20b401c4a3e1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:06.297816 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9cd9703-99ee-4ed4-8c2d-20b401c4a3e1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:06.298481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9cd9703-99ee-4ed4-8c2d-20b401c4a3e1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:06.298926 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9cd9703-99ee-4ed4-8c2d-20b401c4a3e1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:06.299341 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9cd9703-99ee-4ed4-8c2d-20b401c4a3e1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:06.479675 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7ed523a1-9353-4cf8-b452-13ed591cbad0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:06.480790 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7ed523a1-9353-4cf8-b452-13ed591cbad0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:06.493391 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ed523a1-9353-4cf8-b452-13ed591cbad0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:06.494597 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ed523a1-9353-4cf8-b452-13ed591cbad0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:06.497391 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ed523a1-9353-4cf8-b452-13ed591cbad0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:06.499022 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ed523a1-9353-4cf8-b452-13ed591cbad0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:06.499642 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ed523a1-9353-4cf8-b452-13ed591cbad0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:06.500598 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ed523a1-9353-4cf8-b452-13ed591cbad0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:06.619045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d9cd9703-99ee-4ed4-8c2d-20b401c4a3e1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:06.640497 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d9cd9703-99ee-4ed4-8c2d-20b401c4a3e1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.354600 Aug 23 22:26:06.641845 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 101/204] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:06 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:06.739514 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7ed523a1-9353-4cf8-b452-13ed591cbad0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:06.755803 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7ed523a1-9353-4cf8-b452-13ed591cbad0 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1554 microversion: 2.1 time: 0.283442 Aug 23 22:26:06.757409 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 104/205] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:06 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1554 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:07.018963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-e39f1bdd-946f-43dd-ade3-3c2baff59a19 req-2d3874a0-4a02-4e04-9ded-dda90a05c333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6155d4-fda2-4409-83f8-0a03e54559bd", "name": "network-vif-deleted", "tag": "2a039e7d-6c60-4fc6-aeeb-33c9d72e8c2e"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:07.031702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-e39f1bdd-946f-43dd-ade3-3c2baff59a19 req-2d3874a0-4a02-4e04-9ded-dda90a05c333 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:07.032405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-e39f1bdd-946f-43dd-ade3-3c2baff59a19 req-2d3874a0-4a02-4e04-9ded-dda90a05c333 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:07.032994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-e39f1bdd-946f-43dd-ade3-3c2baff59a19 req-2d3874a0-4a02-4e04-9ded-dda90a05c333 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:07.051399 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-e39f1bdd-946f-43dd-ade3-3c2baff59a19 req-2d3874a0-4a02-4e04-9ded-dda90a05c333 service nova] Creating event network-vif-deleted:2a039e7d-6c60-4fc6-aeeb-33c9d72e8c2e for instance 1f6155d4-fda2-4409-83f8-0a03e54559bd on hv-cinder-85032 Aug 23 22:26:07.059793 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-e39f1bdd-946f-43dd-ade3-3c2baff59a19 req-2d3874a0-4a02-4e04-9ded-dda90a05c333 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043594 Aug 23 22:26:07.060699 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 102/206] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:26:07.109584 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-346013f2-f6f8-464e-82e3-eea9a6505758 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:07.110959 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-346013f2-f6f8-464e-82e3-eea9a6505758 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:07.123300 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-346013f2-f6f8-464e-82e3-eea9a6505758 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:07.124216 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-346013f2-f6f8-464e-82e3-eea9a6505758 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:07.124749 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-346013f2-f6f8-464e-82e3-eea9a6505758 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:07.125792 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-346013f2-f6f8-464e-82e3-eea9a6505758 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:07.126407 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-346013f2-f6f8-464e-82e3-eea9a6505758 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:07.127041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-346013f2-f6f8-464e-82e3-eea9a6505758 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:07.322331 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-346013f2-f6f8-464e-82e3-eea9a6505758 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:07.332571 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-346013f2-f6f8-464e-82e3-eea9a6505758 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1497 microversion: 2.1 time: 0.231618 Aug 23 22:26:07.333203 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 105/207] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:07 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:07.665307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-205cc038-e3c4-4aeb-8340-adfa1d0266c2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:07.666050 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-205cc038-e3c4-4aeb-8340-adfa1d0266c2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:07.674597 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-205cc038-e3c4-4aeb-8340-adfa1d0266c2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:07.675091 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-205cc038-e3c4-4aeb-8340-adfa1d0266c2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:07.675562 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-205cc038-e3c4-4aeb-8340-adfa1d0266c2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:07.676272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-205cc038-e3c4-4aeb-8340-adfa1d0266c2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:07.676722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-205cc038-e3c4-4aeb-8340-adfa1d0266c2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:07.677185 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-205cc038-e3c4-4aeb-8340-adfa1d0266c2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:07.782966 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ce3bb68e-4158-4524-9525-ba3a3a401e0c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:07.783912 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ce3bb68e-4158-4524-9525-ba3a3a401e0c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:07.791920 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce3bb68e-4158-4524-9525-ba3a3a401e0c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:07.793768 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce3bb68e-4158-4524-9525-ba3a3a401e0c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:07.794799 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce3bb68e-4158-4524-9525-ba3a3a401e0c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:07.796041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce3bb68e-4158-4524-9525-ba3a3a401e0c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:07.796650 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce3bb68e-4158-4524-9525-ba3a3a401e0c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:07.797324 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ce3bb68e-4158-4524-9525-ba3a3a401e0c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:07.854368 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-205cc038-e3c4-4aeb-8340-adfa1d0266c2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:07.879456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-205cc038-e3c4-4aeb-8340-adfa1d0266c2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.218750 Aug 23 22:26:07.880111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 103/208] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:07 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:07.897540 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ce3bb68e-4158-4524-9525-ba3a3a401e0c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:07.907359 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ce3bb68e-4158-4524-9525-ba3a3a401e0c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1345 microversion: 2.1 time: 0.131131 Aug 23 22:26:07.908031 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 106/209] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:07 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:08.407462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-358571a7-f96c-43e8-ab88-f61dc4677069 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:08.407846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-358571a7-f96c-43e8-ab88-f61dc4677069 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:08.415178 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-358571a7-f96c-43e8-ab88-f61dc4677069 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:08.415789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-358571a7-f96c-43e8-ab88-f61dc4677069 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:08.416216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-358571a7-f96c-43e8-ab88-f61dc4677069 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:08.417775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-358571a7-f96c-43e8-ab88-f61dc4677069 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:08.418905 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-358571a7-f96c-43e8-ab88-f61dc4677069 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:08.419631 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-358571a7-f96c-43e8-ab88-f61dc4677069 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:08.453744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-358571a7-f96c-43e8-ab88-f61dc4677069 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:26:08.572524 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-358571a7-f96c-43e8-ab88-f61dc4677069 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 204 len: 0 microversion: 2.1 time: 0.168558 Aug 23 22:26:08.574318 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 104/210] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:26:08 2022] DELETE /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:26:08.590256 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-2a796a90-c93f-4096-bfd3-07a3fa99f98f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:08.591406 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-2a796a90-c93f-4096-bfd3-07a3fa99f98f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:08.603501 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2a796a90-c93f-4096-bfd3-07a3fa99f98f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:08.604242 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2a796a90-c93f-4096-bfd3-07a3fa99f98f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:08.605596 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2a796a90-c93f-4096-bfd3-07a3fa99f98f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:08.607081 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2a796a90-c93f-4096-bfd3-07a3fa99f98f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:08.608067 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2a796a90-c93f-4096-bfd3-07a3fa99f98f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:08.608839 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2a796a90-c93f-4096-bfd3-07a3fa99f98f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:08.900044 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-2a796a90-c93f-4096-bfd3-07a3fa99f98f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:08.910550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3d75574f-bc9c-4cc1-878b-d8f7a25dcf4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:08.911136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3d75574f-bc9c-4cc1-878b-d8f7a25dcf4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:08.916180 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-2a796a90-c93f-4096-bfd3-07a3fa99f98f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1503 microversion: 2.1 time: 0.334290 Aug 23 22:26:08.923399 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 107/211] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:08 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1503 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:08.923661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3d75574f-bc9c-4cc1-878b-d8f7a25dcf4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:08.923661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3d75574f-bc9c-4cc1-878b-d8f7a25dcf4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:08.923661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3d75574f-bc9c-4cc1-878b-d8f7a25dcf4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:08.923661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3d75574f-bc9c-4cc1-878b-d8f7a25dcf4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:08.924235 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3d75574f-bc9c-4cc1-878b-d8f7a25dcf4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:08.924235 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3d75574f-bc9c-4cc1-878b-d8f7a25dcf4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:08.934113 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:08.935469 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:08.947055 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:08.947696 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:08.948829 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:08.950640 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:08.952041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:08.953318 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:09.012342 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:09.013406 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:09.014773 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:09.016926 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.objects.instance [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lazy-loading 'fault' on Instance uuid 1f6155d4-fda2-4409-83f8-0a03e54559bd {{(pid=120855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:26:09.093098 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:09.106585 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-dc2076f9-4ecd-4efd-aeaa-a93d8436deb4 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1350 microversion: 2.1 time: 0.179500 Aug 23 22:26:09.107618 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 108/212] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:08 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1350 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:09.125750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3d75574f-bc9c-4cc1-878b-d8f7a25dcf4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:09.137444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3d75574f-bc9c-4cc1-878b-d8f7a25dcf4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.232141 Aug 23 22:26:09.138243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 105/213] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:08 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:09.947196 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b798237e-3c55-43c2-8df6-45183d2d2237 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:09.948131 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-b798237e-3c55-43c2-8df6-45183d2d2237 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:09.958166 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b798237e-3c55-43c2-8df6-45183d2d2237 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:09.960181 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b798237e-3c55-43c2-8df6-45183d2d2237 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:09.961409 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b798237e-3c55-43c2-8df6-45183d2d2237 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:09.963207 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b798237e-3c55-43c2-8df6-45183d2d2237 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:09.965139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b798237e-3c55-43c2-8df6-45183d2d2237 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:09.965782 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b798237e-3c55-43c2-8df6-45183d2d2237 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:10.127684 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-b798237e-3c55-43c2-8df6-45183d2d2237 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:10.136739 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-b798237e-3c55-43c2-8df6-45183d2d2237 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1503 microversion: 2.1 time: 0.196774 Aug 23 22:26:10.137367 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 109/214] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:09 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:10.158201 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:10.159225 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:10.160744 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-509fe01e-0fd8-4c91-9261-4aa48d0f3f1f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:10.161449 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-509fe01e-0fd8-4c91-9261-4aa48d0f3f1f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:10.169244 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-509fe01e-0fd8-4c91-9261-4aa48d0f3f1f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:10.169719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-509fe01e-0fd8-4c91-9261-4aa48d0f3f1f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:10.170321 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-509fe01e-0fd8-4c91-9261-4aa48d0f3f1f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:10.170829 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:10.171384 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-509fe01e-0fd8-4c91-9261-4aa48d0f3f1f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:10.171656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:10.171991 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-509fe01e-0fd8-4c91-9261-4aa48d0f3f1f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:10.172477 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:10.172677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-509fe01e-0fd8-4c91-9261-4aa48d0f3f1f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:10.173490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:10.174289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:10.174997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:10.237093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:10.237700 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:10.238393 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:10.238954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lazy-loading 'fault' on Instance uuid 1f6155d4-fda2-4409-83f8-0a03e54559bd {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:26:10.318690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:10.333576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-20bd8bb2-f0a5-406d-abc0-26ff51bd5c7c tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1350 microversion: 2.1 time: 0.182346 Aug 23 22:26:10.334643 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 106/215] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:10 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1350 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:10.383565 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-509fe01e-0fd8-4c91-9261-4aa48d0f3f1f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:10.396362 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-509fe01e-0fd8-4c91-9261-4aa48d0f3f1f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.239033 Aug 23 22:26:10.397705 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 110/216] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:10 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:11.162390 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9d5fc5a4-f9ad-439f-b66b-a77f0bc7c2c3 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:11.163426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9d5fc5a4-f9ad-439f-b66b-a77f0bc7c2c3 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:11.177344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d5fc5a4-f9ad-439f-b66b-a77f0bc7c2c3 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:11.178217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d5fc5a4-f9ad-439f-b66b-a77f0bc7c2c3 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:11.178989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d5fc5a4-f9ad-439f-b66b-a77f0bc7c2c3 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:11.180504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d5fc5a4-f9ad-439f-b66b-a77f0bc7c2c3 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:11.181339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d5fc5a4-f9ad-439f-b66b-a77f0bc7c2c3 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:11.182355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d5fc5a4-f9ad-439f-b66b-a77f0bc7c2c3 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:11.363546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:11.365002 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:11.368443 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:11.376974 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:11.378075 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:11.378738 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:11.379688 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:11.380692 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:11.381371 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:11.462178 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:11.463609 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:11.465090 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:11.466059 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.objects.instance [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lazy-loading 'fault' on Instance uuid 1f6155d4-fda2-4409-83f8-0a03e54559bd {{(pid=120855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:26:11.539276 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e884c4f24db45a786618fc28d19bced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398769c58d0d412aa45024c937820ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:11.557377 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-98d4d689-1b44-4e5c-a70b-632b07cc4d84 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 200 len: 1350 microversion: 2.1 time: 0.200679 Aug 23 22:26:11.559715 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 111/217] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:11 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 1350 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:11.569036 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-98ee2c20-091a-43f3-a95c-0af9a6c17f1d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:11.570548 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-98ee2c20-091a-43f3-a95c-0af9a6c17f1d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:11.582446 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98ee2c20-091a-43f3-a95c-0af9a6c17f1d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:11.583444 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98ee2c20-091a-43f3-a95c-0af9a6c17f1d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:11.584370 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98ee2c20-091a-43f3-a95c-0af9a6c17f1d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:11.586099 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98ee2c20-091a-43f3-a95c-0af9a6c17f1d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:11.587066 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98ee2c20-091a-43f3-a95c-0af9a6c17f1d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:11.587969 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-98ee2c20-091a-43f3-a95c-0af9a6c17f1d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:11.622143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9d5fc5a4-f9ad-439f-b66b-a77f0bc7c2c3 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:11.643751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9d5fc5a4-f9ad-439f-b66b-a77f0bc7c2c3 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1503 microversion: 2.1 time: 0.488028 Aug 23 22:26:11.644711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 107/218] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:11 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1503 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:11.842936 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-98ee2c20-091a-43f3-a95c-0af9a6c17f1d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:11.853961 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-98ee2c20-091a-43f3-a95c-0af9a6c17f1d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.292343 Aug 23 22:26:11.855708 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 112/219] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:11 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:12.584749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:12.585977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:12.595875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:12.596637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:12.597260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:12.598160 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:12.598762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:12.599297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:12.615966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] HTTP exception thrown: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Request method failure captured: Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd HTTP/1.1 Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOz_ECh9FhrDbSdBRl_f5f8taxt006Oz2ywBUsmJNZ5q6MYUDoeWTaykdBBTyAyVF0O6_D9KmS1iNBNEbfWKxHbaaUh0Viqe6UkI0xq59eO8nlvuWb1ze_nzMjHRCMBI-GClUJeNaCJRon8wHfMaK4cTfvIQxHLEMPo86GTBbAgot8 Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 398769c58d0d412aa45024c937820ba1 Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:26:12.621040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/398769c58d0d412aa45024c937820ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_398769c58d0d412aa45024c937820ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/398769c58d0d412aa45024c937820ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/398769c58d0d412aa45024c937820ba1"}]}] Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 398769c58d0d412aa45024c937820ba1 Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-DeleteServersTestJSON-254731468-project Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 4e884c4f24db45a786618fc28d19bced Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-DeleteServersTestJSON-254731468-project Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:12.622528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '1f6155d4-fda2-4409-83f8-0a03e54559bd'} Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:26:12.623223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:12.624428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:12.625536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Returning 404 to user: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:26:12.625536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-013bc8ed-3152-4869-9643-ee5c4d5e3770 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 404 len: 111 microversion: 2.1 time: 0.042917 Aug 23 22:26:12.625536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 108/220] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:12 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:26:12.685799 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ebc07cfb-dc6c-42f9-9063-e1cc83f5ef1e tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:12.693244 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ebc07cfb-dc6c-42f9-9063-e1cc83f5ef1e tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:12.706727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ebc07cfb-dc6c-42f9-9063-e1cc83f5ef1e tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:12.707909 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ebc07cfb-dc6c-42f9-9063-e1cc83f5ef1e tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:12.708764 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ebc07cfb-dc6c-42f9-9063-e1cc83f5ef1e tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:12.710373 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ebc07cfb-dc6c-42f9-9063-e1cc83f5ef1e tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:12.711694 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ebc07cfb-dc6c-42f9-9063-e1cc83f5ef1e tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:12.712601 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ebc07cfb-dc6c-42f9-9063-e1cc83f5ef1e tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:12.783337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:12.789655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:12.798320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:12.804898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:12.805797 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:12.807011 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:12.807695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:12.808686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:12.832849 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] HTTP exception thrown: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Request method failure captured: Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd/os-volume_attachments HTTP/1.1 Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOz_ECh9FhrDbSdBRl_f5f8taxt006Oz2ywBUsmJNZ5q6MYUDoeWTaykdBBTyAyVF0O6_D9KmS1iNBNEbfWKxHbaaUh0Viqe6UkI0xq59eO8nlvuWb1ze_nzMjHRCMBI-GClUJeNaCJRon8wHfMaK4cTfvIQxHLEMPo86GTBbAgot8 Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 398769c58d0d412aa45024c937820ba1 Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:26:12.835044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/398769c58d0d412aa45024c937820ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_398769c58d0d412aa45024c937820ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/398769c58d0d412aa45024c937820ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/398769c58d0d412aa45024c937820ba1"}]}] Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 398769c58d0d412aa45024c937820ba1 Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-DeleteServersTestJSON-254731468-project Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 4e884c4f24db45a786618fc28d19bced Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-DeleteServersTestJSON-254731468-project Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:12.836780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'server_id': '1f6155d4-fda2-4409-83f8-0a03e54559bd'} Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:26:12.837770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:12.839815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:12.842573 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Returning 404 to user: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:26:12.843615 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4bd37bd2-77d1-4c1c-a576-d3a53960901e tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065422 Aug 23 22:26:12.844638 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 109/221] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:26:12 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:26:12.879862 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-caa824c2-fb83-4ad8-a794-76b3f72223d6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:12.880489 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-caa824c2-fb83-4ad8-a794-76b3f72223d6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:12.894552 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-caa824c2-fb83-4ad8-a794-76b3f72223d6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:12.895400 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-caa824c2-fb83-4ad8-a794-76b3f72223d6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:12.896191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-caa824c2-fb83-4ad8-a794-76b3f72223d6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:12.898584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-caa824c2-fb83-4ad8-a794-76b3f72223d6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:12.899724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-caa824c2-fb83-4ad8-a794-76b3f72223d6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:12.900697 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-caa824c2-fb83-4ad8-a794-76b3f72223d6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:12.958622 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ebc07cfb-dc6c-42f9-9063-e1cc83f5ef1e tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:12.978391 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ebc07cfb-dc6c-42f9-9063-e1cc83f5ef1e tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1503 microversion: 2.1 time: 0.295439 Aug 23 22:26:12.978391 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 113/222] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:12 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:13.390358 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-caa824c2-fb83-4ad8-a794-76b3f72223d6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:13.407014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-caa824c2-fb83-4ad8-a794-76b3f72223d6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.531990 Aug 23 22:26:13.407585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 110/223] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:12 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:14.021335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-154e2d6e-987c-4ce9-8243-740a19cbcf87 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:14.022173 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-154e2d6e-987c-4ce9-8243-740a19cbcf87 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:14.040913 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-154e2d6e-987c-4ce9-8243-740a19cbcf87 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:14.041972 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-154e2d6e-987c-4ce9-8243-740a19cbcf87 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:14.043975 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-154e2d6e-987c-4ce9-8243-740a19cbcf87 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:14.045714 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-154e2d6e-987c-4ce9-8243-740a19cbcf87 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:14.046558 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-154e2d6e-987c-4ce9-8243-740a19cbcf87 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:14.047515 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-154e2d6e-987c-4ce9-8243-740a19cbcf87 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:14.239828 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:14.240321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:14.251945 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:14.252436 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:14.252871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:14.253764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:14.254324 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:14.259025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:14.290650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] HTTP exception thrown: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Request method failure captured: Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd HTTP/1.1 Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOz_ECh9FhrDbSdBRl_f5f8taxt006Oz2ywBUsmJNZ5q6MYUDoeWTaykdBBTyAyVF0O6_D9KmS1iNBNEbfWKxHbaaUh0Viqe6UkI0xq59eO8nlvuWb1ze_nzMjHRCMBI-GClUJeNaCJRon8wHfMaK4cTfvIQxHLEMPo86GTBbAgot8 Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 398769c58d0d412aa45024c937820ba1 Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:26:14.292756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/398769c58d0d412aa45024c937820ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_398769c58d0d412aa45024c937820ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/398769c58d0d412aa45024c937820ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/398769c58d0d412aa45024c937820ba1"}]}] Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 398769c58d0d412aa45024c937820ba1 Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-DeleteServersTestJSON-254731468-project Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 4e884c4f24db45a786618fc28d19bced Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-DeleteServersTestJSON-254731468-project Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:14.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '1f6155d4-fda2-4409-83f8-0a03e54559bd'} Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:26:14.295892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:14.298085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:14.300141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Returning 404 to user: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:26:14.300141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ac7e97c8-40ca-4420-aa7e-1c42401ff57a tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 404 len: 111 microversion: 2.1 time: 0.058882 Aug 23 22:26:14.300141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 111/224] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:26:14 2022] DELETE /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:26:14.315179 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:14.315917 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] [instance: 1f6155d4-fda2-4409-83f8-0a03e54559bd] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:14.334059 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-154e2d6e-987c-4ce9-8243-740a19cbcf87 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:14.334494 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:14.334992 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:14.335500 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:14.336402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:14.337014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:14.337633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:14.355785 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] HTTP exception thrown: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Request method failure captured: Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd HTTP/1.1 Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOz_ECh9FhrDbSdBRl_f5f8taxt006Oz2ywBUsmJNZ5q6MYUDoeWTaykdBBTyAyVF0O6_D9KmS1iNBNEbfWKxHbaaUh0Viqe6UkI0xq59eO8nlvuWb1ze_nzMjHRCMBI-GClUJeNaCJRon8wHfMaK4cTfvIQxHLEMPo86GTBbAgot8 Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 398769c58d0d412aa45024c937820ba1 Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:26:14.357384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/398769c58d0d412aa45024c937820ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_398769c58d0d412aa45024c937820ba1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/398769c58d0d412aa45024c937820ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/398769c58d0d412aa45024c937820ba1"}]}] Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 398769c58d0d412aa45024c937820ba1 Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-DeleteServersTestJSON-254731468 Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-DeleteServersTestJSON-254731468-project Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 4e884c4f24db45a786618fc28d19bced Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-DeleteServersTestJSON-254731468-project Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:14.373136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '1f6155d4-fda2-4409-83f8-0a03e54559bd'} Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:26:14.374260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. Aug 23 22:26:14.376102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:26:14.377435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] Returning 404 to user: Instance 1f6155d4-fda2-4409-83f8-0a03e54559bd could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:26:14.377521 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-154e2d6e-987c-4ce9-8243-740a19cbcf87 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1503 microversion: 2.1 time: 0.341125 Aug 23 22:26:14.377521 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 114/225] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:14 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:14.377681 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bccfc9fe-990f-4338-80e1-31185dddcc15 tempest-DeleteServersTestJSON-254731468 tempest-DeleteServersTestJSON-254731468-project] 10.222.0.88 "GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd" status: 404 len: 111 microversion: 2.1 time: 0.048716 Aug 23 22:26:14.377681 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 112/226] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:14 2022] GET /compute/v2.1/servers/1f6155d4-fda2-4409-83f8-0a03e54559bd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:26:14.438052 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b56b245a-fa46-455d-8bbb-0c2b7d9060f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:14.439173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b56b245a-fa46-455d-8bbb-0c2b7d9060f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:14.443372 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-c65ac01b-b4d9-40e9-8e87-b606cf3e610c req-8d216f79-d418-4f3c-bc5d-6d2abe876141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41cb922-8ceb-4d97-991a-7a3f88002bd1", "name": "network-vif-deleted", "tag": "86d62334-8569-42b8-a145-9361fc05ffcf"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:14.467314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b56b245a-fa46-455d-8bbb-0c2b7d9060f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:14.468217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b56b245a-fa46-455d-8bbb-0c2b7d9060f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:14.468928 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b56b245a-fa46-455d-8bbb-0c2b7d9060f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:14.470309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b56b245a-fa46-455d-8bbb-0c2b7d9060f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:14.471146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b56b245a-fa46-455d-8bbb-0c2b7d9060f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:14.471977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b56b245a-fa46-455d-8bbb-0c2b7d9060f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:14.482230 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-c65ac01b-b4d9-40e9-8e87-b606cf3e610c req-8d216f79-d418-4f3c-bc5d-6d2abe876141 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:14.483346 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-c65ac01b-b4d9-40e9-8e87-b606cf3e610c req-8d216f79-d418-4f3c-bc5d-6d2abe876141 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:14.484450 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-c65ac01b-b4d9-40e9-8e87-b606cf3e610c req-8d216f79-d418-4f3c-bc5d-6d2abe876141 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:14.518739 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-c65ac01b-b4d9-40e9-8e87-b606cf3e610c req-8d216f79-d418-4f3c-bc5d-6d2abe876141 service nova] Creating event network-vif-deleted:86d62334-8569-42b8-a145-9361fc05ffcf for instance d41cb922-8ceb-4d97-991a-7a3f88002bd1 on hv-cinder-85032 Aug 23 22:26:14.528828 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:14.531364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-c65ac01b-b4d9-40e9-8e87-b606cf3e610c req-8d216f79-d418-4f3c-bc5d-6d2abe876141 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101289 Aug 23 22:26:14.534136 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 115/227] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:26:15.124583 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b56b245a-fa46-455d-8bbb-0c2b7d9060f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:15.140899 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b56b245a-fa46-455d-8bbb-0c2b7d9060f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.709925 Aug 23 22:26:15.179613 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 113/228] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:14 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:15.399404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:15.404655 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:15.432132 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:15.434088 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:15.435387 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:15.440475 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:15.441594 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:15.442440 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:15.503890 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:15.504508 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:15.505009 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:15.505571 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.objects.instance [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lazy-loading 'fault' on Instance uuid d41cb922-8ceb-4d97-991a-7a3f88002bd1 {{(pid=120855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:26:15.509640 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=100 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:15.628788 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:15.641588 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7da599c9-386c-45be-801e-31ce3566481c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 200 len: 1304 microversion: 2.1 time: 0.262119 Aug 23 22:26:15.644880 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 116/229] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:15 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 1304 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:16.193406 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4fcd04e2-df42-4700-8d1f-3a91df357711 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:16.194774 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4fcd04e2-df42-4700-8d1f-3a91df357711 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:16.221120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4fcd04e2-df42-4700-8d1f-3a91df357711 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:16.221995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4fcd04e2-df42-4700-8d1f-3a91df357711 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:16.226894 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4fcd04e2-df42-4700-8d1f-3a91df357711 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:16.228322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4fcd04e2-df42-4700-8d1f-3a91df357711 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:16.229025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4fcd04e2-df42-4700-8d1f-3a91df357711 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:16.230378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4fcd04e2-df42-4700-8d1f-3a91df357711 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:16.702167 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:16.703647 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: d41cb922-8ceb-4d97-991a-7a3f88002bd1] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:16.715967 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:16.717650 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:16.718420 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:16.719726 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:16.720680 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:16.721576 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:16.744026 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.wsgi [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] HTTP exception thrown: Instance d41cb922-8ceb-4d97-991a-7a3f88002bd1 could not be found. Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Request method failure captured: Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: request: GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 HTTP/1.1 Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept: application/json Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept-Encoding: identity Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Connection: close Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Length: 0 Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Type: application/json Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Host: 10.222.0.88 Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Openstack-System-Scope: None Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: User-Agent: python-urllib3/1.26.11 Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Auth-Token: gAAAAABjBVPgfymDEhTxYnAcj-YGB1LzfQP0gfSVkitN5mmxEhfhNx9V3Oxcl9_44_0j6RM6KmavLtWoGjy3lUiqqSxTRfki2weNdpxxJoBfIuqOs-8pRf32_oXdceImrJLP4InmiVLlJBh7W4kyyqnK3Gsa6IxXvBBT5nJwsfg2HM886VJVfbw Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Id: None Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Name: None Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Identity-Status: Confirmed Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Is-Admin-Project: True Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Id: default Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Name: Default Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Id: e5196561b7ae4adbb110ce06e81401f7 Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Name: tempest-VolumesActionsTest-421002477 Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Role: member,reader Aug 23 22:26:16.753201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Roles: member,reader Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e5196561b7ae4adbb110ce06e81401f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e5196561b7ae4adbb110ce06e81401f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e5196561b7ae4adbb110ce06e81401f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e5196561b7ae4adbb110ce06e81401f7"}]}] Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant: tempest-VolumesActionsTest-421002477 Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Id: e5196561b7ae4adbb110ce06e81401f7 Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Name: tempest-VolumesActionsTest-421002477 Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User: tempest-VolumesActionsTest-421002477-project Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Id: default Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Name: Default Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Id: ba49197c9a3446b68bc92c48abf57b37 Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Name: tempest-VolumesActionsTest-421002477-project Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: method: > Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: exception: Instance d41cb922-8ceb-4d97-991a-7a3f88002bd1 could not be found. Aug 23 22:26:16.754474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: action_args: {'id': 'd41cb922-8ceb-4d97-991a-7a3f88002bd1'} Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d41cb922-8ceb-4d97-991a-7a3f88002bd1 could not be found. Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:26:16.755184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d41cb922-8ceb-4d97-991a-7a3f88002bd1 could not be found. Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d41cb922-8ceb-4d97-991a-7a3f88002bd1 could not be found. Aug 23 22:26:16.756910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:16.763134 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4fcd04e2-df42-4700-8d1f-3a91df357711 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:16.775221 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Returning 404 to user: Instance d41cb922-8ceb-4d97-991a-7a3f88002bd1 could not be found. {{(pid=120855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:26:16.780787 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-bf089936-e1b1-4837-a458-8fb20ac6920d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1" status: 404 len: 111 microversion: 2.1 time: 0.099575 Aug 23 22:26:16.782925 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 117/230] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:16 2022] GET /compute/v2.1/servers/d41cb922-8ceb-4d97-991a-7a3f88002bd1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:26:16.816634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4fcd04e2-df42-4700-8d1f-3a91df357711 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.638700 Aug 23 22:26:16.817483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 114/231] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:16 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:17.070693 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1003633099", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "networks": [{"uuid": "4af96f9d-d5a7-41bf-8b06-63f6dd287e47"}]}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:17.159371 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.network.neutron [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] validate_networks() for [('4af96f9d-d5a7-41bf-8b06-63f6dd287e47', None, None, None, None, None)] {{(pid=120855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:26:17.847800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8d79c23d-43e0-4b53-8790-43627ec785f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:17.849171 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8d79c23d-43e0-4b53-8790-43627ec785f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:17.867313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d79c23d-43e0-4b53-8790-43627ec785f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:17.867313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d79c23d-43e0-4b53-8790-43627ec785f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:17.867313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d79c23d-43e0-4b53-8790-43627ec785f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:17.868953 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d79c23d-43e0-4b53-8790-43627ec785f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:17.869756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d79c23d-43e0-4b53-8790-43627ec785f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:17.872677 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d79c23d-43e0-4b53-8790-43627ec785f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:18.040132 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Flavor limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:26:18.040926 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Image limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:26:18.041105 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Flavor pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:26:18.041425 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Image pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:26:18.042366 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:26:18.061794 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:18.062462 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:18.063063 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:18.064044 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:18.064636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:18.065240 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:18.123074 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Getting quotas for project e5196561b7ae4adbb110ce06e81401f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:26:18.129007 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Getting quotas for user ba49197c9a3446b68bc92c48abf57b37 and project e5196561b7ae4adbb110ce06e81401f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:26:18.169114 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Going to run 1 instances... {{(pid=120855) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:26:18.172939 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:26:18.253642 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7033cf43-9e8a-4f0f-8f76-2e8e6f7fe8b6 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.188298 Aug 23 22:26:18.261344 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 118/232] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:26:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:26:18.268920 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-58376432-8118-4515-9eb2-2daaaf6944ea tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:18.269722 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-58376432-8118-4515-9eb2-2daaaf6944ea tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:18.381731 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-58376432-8118-4515-9eb2-2daaaf6944ea tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:18.393132 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-58376432-8118-4515-9eb2-2daaaf6944ea tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1214 microversion: 2.1 time: 0.130309 Aug 23 22:26:18.408612 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 119/233] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:18 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:18.483749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8d79c23d-43e0-4b53-8790-43627ec785f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:18.518444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8d79c23d-43e0-4b53-8790-43627ec785f7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.679675 Aug 23 22:26:18.525285 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 115/234] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:17 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:19.416550 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e1aab6cf-c9dc-42cb-9f5d-f291bdd0341c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:19.418101 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e1aab6cf-c9dc-42cb-9f5d-f291bdd0341c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:19.432039 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e1aab6cf-c9dc-42cb-9f5d-f291bdd0341c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:19.432743 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e1aab6cf-c9dc-42cb-9f5d-f291bdd0341c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:19.437404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e1aab6cf-c9dc-42cb-9f5d-f291bdd0341c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:19.438869 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e1aab6cf-c9dc-42cb-9f5d-f291bdd0341c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:19.439561 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e1aab6cf-c9dc-42cb-9f5d-f291bdd0341c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:19.441565 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e1aab6cf-c9dc-42cb-9f5d-f291bdd0341c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:19.543974 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-19952326-f0ee-4e27-aef0-63caee46731e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:19.544731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-19952326-f0ee-4e27-aef0-63caee46731e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:19.560953 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19952326-f0ee-4e27-aef0-63caee46731e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:19.561486 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19952326-f0ee-4e27-aef0-63caee46731e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:19.564930 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19952326-f0ee-4e27-aef0-63caee46731e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:19.566267 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19952326-f0ee-4e27-aef0-63caee46731e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:19.571811 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19952326-f0ee-4e27-aef0-63caee46731e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:19.572389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19952326-f0ee-4e27-aef0-63caee46731e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:19.634109 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e1aab6cf-c9dc-42cb-9f5d-f291bdd0341c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:19.661576 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e1aab6cf-c9dc-42cb-9f5d-f291bdd0341c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1210 microversion: 2.1 time: 0.243429 Aug 23 22:26:19.666125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 120/235] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:19 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1210 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:19.954560 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-19952326-f0ee-4e27-aef0-63caee46731e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:19.989820 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-19952326-f0ee-4e27-aef0-63caee46731e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1521 microversion: 2.1 time: 0.451560 Aug 23 22:26:19.990447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 116/236] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:19 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:20.689193 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-34866016-02bb-492e-8c16-3ba27b5d606d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:20.691145 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-34866016-02bb-492e-8c16-3ba27b5d606d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:20.712439 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-34866016-02bb-492e-8c16-3ba27b5d606d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:20.725172 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-34866016-02bb-492e-8c16-3ba27b5d606d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:20.742801 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-34866016-02bb-492e-8c16-3ba27b5d606d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:20.747006 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-34866016-02bb-492e-8c16-3ba27b5d606d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:20.748197 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-34866016-02bb-492e-8c16-3ba27b5d606d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:20.750335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-34866016-02bb-492e-8c16-3ba27b5d606d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:20.940842 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-34866016-02bb-492e-8c16-3ba27b5d606d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:20.969329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-34866016-02bb-492e-8c16-3ba27b5d606d tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1266 microversion: 2.1 time: 0.284713 Aug 23 22:26:20.987736 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 121/237] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:20 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:21.014332 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b1c2bc7f-29e6-49fa-98bb-7b9f6adec909 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:21.017515 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b1c2bc7f-29e6-49fa-98bb-7b9f6adec909 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:21.036987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b1c2bc7f-29e6-49fa-98bb-7b9f6adec909 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:21.044051 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b1c2bc7f-29e6-49fa-98bb-7b9f6adec909 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:21.046142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b1c2bc7f-29e6-49fa-98bb-7b9f6adec909 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:21.051931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b1c2bc7f-29e6-49fa-98bb-7b9f6adec909 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:21.053043 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b1c2bc7f-29e6-49fa-98bb-7b9f6adec909 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:21.054266 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b1c2bc7f-29e6-49fa-98bb-7b9f6adec909 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:21.743542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b1c2bc7f-29e6-49fa-98bb-7b9f6adec909 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:21.760919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b1c2bc7f-29e6-49fa-98bb-7b9f6adec909 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1501 microversion: 2.1 time: 0.750367 Aug 23 22:26:21.771619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 117/238] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:21 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1501 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:21.812583 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-56c68fb1-68e7-41be-9a6c-b69c476febb5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:21.813281 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-56c68fb1-68e7-41be-9a6c-b69c476febb5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:21.826575 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56c68fb1-68e7-41be-9a6c-b69c476febb5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:21.828423 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56c68fb1-68e7-41be-9a6c-b69c476febb5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:21.829833 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56c68fb1-68e7-41be-9a6c-b69c476febb5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:21.831929 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56c68fb1-68e7-41be-9a6c-b69c476febb5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:21.833580 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56c68fb1-68e7-41be-9a6c-b69c476febb5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:21.834412 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56c68fb1-68e7-41be-9a6c-b69c476febb5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:22.019718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0de40679-1db4-4e31-b6a5-0287963eab32 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:22.026279 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0de40679-1db4-4e31-b6a5-0287963eab32 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:22.082773 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0de40679-1db4-4e31-b6a5-0287963eab32 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:22.083739 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0de40679-1db4-4e31-b6a5-0287963eab32 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:22.084440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0de40679-1db4-4e31-b6a5-0287963eab32 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:22.085694 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0de40679-1db4-4e31-b6a5-0287963eab32 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:22.090899 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0de40679-1db4-4e31-b6a5-0287963eab32 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:22.092439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0de40679-1db4-4e31-b6a5-0287963eab32 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:22.344909 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-56c68fb1-68e7-41be-9a6c-b69c476febb5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:22.357738 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-56c68fb1-68e7-41be-9a6c-b69c476febb5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1515 microversion: 2.1 time: 0.552064 Aug 23 22:26:22.372544 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 122/239] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:21 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1515 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:22.453110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0de40679-1db4-4e31-b6a5-0287963eab32 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:22.509567 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0de40679-1db4-4e31-b6a5-0287963eab32 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1272 microversion: 2.1 time: 0.500067 Aug 23 22:26:22.515917 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 118/240] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:22 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1272 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:23.538275 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-10272449-42b7-4e2c-87bb-011302f75400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:23.539734 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-10272449-42b7-4e2c-87bb-011302f75400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:23.550043 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-10272449-42b7-4e2c-87bb-011302f75400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:23.550886 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-10272449-42b7-4e2c-87bb-011302f75400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:23.551560 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-10272449-42b7-4e2c-87bb-011302f75400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:23.553023 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-10272449-42b7-4e2c-87bb-011302f75400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:23.553959 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-10272449-42b7-4e2c-87bb-011302f75400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:23.554660 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-10272449-42b7-4e2c-87bb-011302f75400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:24.344144 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a68a7bec-f277-42d0-b197-93870886ee28 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:24.346553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a68a7bec-f277-42d0-b197-93870886ee28 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:24.362312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a68a7bec-f277-42d0-b197-93870886ee28 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:24.364155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a68a7bec-f277-42d0-b197-93870886ee28 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:24.365852 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a68a7bec-f277-42d0-b197-93870886ee28 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:24.366835 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a68a7bec-f277-42d0-b197-93870886ee28 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:24.370515 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a68a7bec-f277-42d0-b197-93870886ee28 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:24.374443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a68a7bec-f277-42d0-b197-93870886ee28 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:24.428398 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-a68a7bec-f277-42d0-b197-93870886ee28 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lazy-loading 'flavor' on Instance uuid 498d6e2f-6d66-4925-8f7c-eca5b08c1025 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:26:24.437541 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-10272449-42b7-4e2c-87bb-011302f75400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:24.450802 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-10272449-42b7-4e2c-87bb-011302f75400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.916189 Aug 23 22:26:24.451403 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 123/241] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:23 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:24.475792 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-3c8545c7-8e1e-4dd8-87a4-df1c85b2f1ce req-25f48879-7574-468b-85f0-56ed92e55a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc119db-5d85-487a-83e0-8356c7d8f9ca", "tag": "64695c1f-234a-4be4-a0c5-8b5936ec66f2"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:24.492944 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-3c8545c7-8e1e-4dd8-87a4-df1c85b2f1ce req-25f48879-7574-468b-85f0-56ed92e55a8c service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:24.493908 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-3c8545c7-8e1e-4dd8-87a4-df1c85b2f1ce req-25f48879-7574-468b-85f0-56ed92e55a8c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:24.494518 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-3c8545c7-8e1e-4dd8-87a4-df1c85b2f1ce req-25f48879-7574-468b-85f0-56ed92e55a8c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:24.532786 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-3c8545c7-8e1e-4dd8-87a4-df1c85b2f1ce req-25f48879-7574-468b-85f0-56ed92e55a8c service nova] Creating event network-changed:64695c1f-234a-4be4-a0c5-8b5936ec66f2 for instance 3cc119db-5d85-487a-83e0-8356c7d8f9ca on hv-cinder-85032 Aug 23 22:26:24.549278 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-3c8545c7-8e1e-4dd8-87a4-df1c85b2f1ce req-25f48879-7574-468b-85f0-56ed92e55a8c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094721 Aug 23 22:26:24.550953 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 124/242] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:26:24.626460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a68a7bec-f277-42d0-b197-93870886ee28 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025/action" status: 200 len: 32 microversion: 2.1 time: 0.286978 Aug 23 22:26:24.627581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 119/243] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:26:24 2022] POST /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025/action => generated 32 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:26:24.641361 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-6445078f-d7aa-43c3-a733-8e51e9403bc8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:24.642768 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-6445078f-d7aa-43c3-a733-8e51e9403bc8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:24.656050 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6445078f-d7aa-43c3-a733-8e51e9403bc8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:24.656659 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6445078f-d7aa-43c3-a733-8e51e9403bc8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:24.658067 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6445078f-d7aa-43c3-a733-8e51e9403bc8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:24.659221 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6445078f-d7aa-43c3-a733-8e51e9403bc8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:24.660127 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6445078f-d7aa-43c3-a733-8e51e9403bc8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:24.660844 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6445078f-d7aa-43c3-a733-8e51e9403bc8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:25.302483 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-6445078f-d7aa-43c3-a733-8e51e9403bc8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:25.342349 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-6445078f-d7aa-43c3-a733-8e51e9403bc8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.705181 Aug 23 22:26:25.359966 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 125/244] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:24 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:25.483216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8292f7ec-25d2-4c3e-ae77-174ff212efb4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:25.484040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8292f7ec-25d2-4c3e-ae77-174ff212efb4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:25.503138 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8292f7ec-25d2-4c3e-ae77-174ff212efb4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:25.503630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8292f7ec-25d2-4c3e-ae77-174ff212efb4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:25.504256 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8292f7ec-25d2-4c3e-ae77-174ff212efb4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:25.505160 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8292f7ec-25d2-4c3e-ae77-174ff212efb4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:25.505769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8292f7ec-25d2-4c3e-ae77-174ff212efb4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:25.506337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8292f7ec-25d2-4c3e-ae77-174ff212efb4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:26.006982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8292f7ec-25d2-4c3e-ae77-174ff212efb4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:26.024491 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8292f7ec-25d2-4c3e-ae77-174ff212efb4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.543547 Aug 23 22:26:26.030268 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 120/245] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:25 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:26.383473 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cf4704dd-7107-43a5-9597-177366ba7e4d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:26.384086 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-cf4704dd-7107-43a5-9597-177366ba7e4d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:26.393677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cf4704dd-7107-43a5-9597-177366ba7e4d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:26.394385 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cf4704dd-7107-43a5-9597-177366ba7e4d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:26.395010 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cf4704dd-7107-43a5-9597-177366ba7e4d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:26.395907 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cf4704dd-7107-43a5-9597-177366ba7e4d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:26.396564 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cf4704dd-7107-43a5-9597-177366ba7e4d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:26.397213 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cf4704dd-7107-43a5-9597-177366ba7e4d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:26.649834 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-cf4704dd-7107-43a5-9597-177366ba7e4d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:26.675014 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-cf4704dd-7107-43a5-9597-177366ba7e4d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.294258 Aug 23 22:26:26.682776 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 126/246] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:26 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:27.052499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bb9326b7-f109-4117-92b4-d0eb0d2a2fe9 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:27.053242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bb9326b7-f109-4117-92b4-d0eb0d2a2fe9 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:27.060715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb9326b7-f109-4117-92b4-d0eb0d2a2fe9 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:27.062746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb9326b7-f109-4117-92b4-d0eb0d2a2fe9 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:27.064399 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb9326b7-f109-4117-92b4-d0eb0d2a2fe9 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:27.065234 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb9326b7-f109-4117-92b4-d0eb0d2a2fe9 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:27.066496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb9326b7-f109-4117-92b4-d0eb0d2a2fe9 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:27.067178 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb9326b7-f109-4117-92b4-d0eb0d2a2fe9 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:27.300512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-bb9326b7-f109-4117-92b4-d0eb0d2a2fe9 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:27.311699 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bb9326b7-f109-4117-92b4-d0eb0d2a2fe9 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.263963 Aug 23 22:26:27.312794 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 121/247] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:27 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:27.714570 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d6569b42-bcb4-4001-9ede-45dbe8c6d1e3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:27.715760 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d6569b42-bcb4-4001-9ede-45dbe8c6d1e3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:27.730957 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6569b42-bcb4-4001-9ede-45dbe8c6d1e3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:27.732474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6569b42-bcb4-4001-9ede-45dbe8c6d1e3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:27.734576 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6569b42-bcb4-4001-9ede-45dbe8c6d1e3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:27.738493 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6569b42-bcb4-4001-9ede-45dbe8c6d1e3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:27.739424 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6569b42-bcb4-4001-9ede-45dbe8c6d1e3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:27.740107 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6569b42-bcb4-4001-9ede-45dbe8c6d1e3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:28.098308 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d6569b42-bcb4-4001-9ede-45dbe8c6d1e3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:28.116126 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d6569b42-bcb4-4001-9ede-45dbe8c6d1e3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.400210 Aug 23 22:26:28.118483 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 127/248] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:27 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:28.337375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bdbc517c-cc99-4f88-8aef-74fcae91c2e1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:28.340436 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bdbc517c-cc99-4f88-8aef-74fcae91c2e1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:28.356647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bdbc517c-cc99-4f88-8aef-74fcae91c2e1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:28.359191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bdbc517c-cc99-4f88-8aef-74fcae91c2e1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:28.360833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bdbc517c-cc99-4f88-8aef-74fcae91c2e1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:28.361796 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bdbc517c-cc99-4f88-8aef-74fcae91c2e1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:28.364054 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bdbc517c-cc99-4f88-8aef-74fcae91c2e1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:28.366999 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bdbc517c-cc99-4f88-8aef-74fcae91c2e1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:28.674675 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-bdbc517c-cc99-4f88-8aef-74fcae91c2e1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:28.683573 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bdbc517c-cc99-4f88-8aef-74fcae91c2e1 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.354676 Aug 23 22:26:28.684439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 122/249] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:28 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:29.146211 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8220fd3a-deaa-4f0c-b8b3-5af8343bb77e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:29.147287 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-8220fd3a-deaa-4f0c-b8b3-5af8343bb77e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:29.168160 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=2 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:29.174879 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=8 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:29.184261 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8220fd3a-deaa-4f0c-b8b3-5af8343bb77e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:29.186737 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8220fd3a-deaa-4f0c-b8b3-5af8343bb77e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:29.190069 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8220fd3a-deaa-4f0c-b8b3-5af8343bb77e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:29.191514 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8220fd3a-deaa-4f0c-b8b3-5af8343bb77e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:29.192872 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8220fd3a-deaa-4f0c-b8b3-5af8343bb77e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:29.193864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8220fd3a-deaa-4f0c-b8b3-5af8343bb77e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:29.418940 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8220fd3a-deaa-4f0c-b8b3-5af8343bb77e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:29.429562 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8220fd3a-deaa-4f0c-b8b3-5af8343bb77e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.291646 Aug 23 22:26:29.433118 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 128/250] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:29 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:29.719332 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-897d8200-8f47-42dc-9ae4-cb4923069195 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:29.720078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-897d8200-8f47-42dc-9ae4-cb4923069195 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:29.728321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-897d8200-8f47-42dc-9ae4-cb4923069195 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:29.729843 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-897d8200-8f47-42dc-9ae4-cb4923069195 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:29.730831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-897d8200-8f47-42dc-9ae4-cb4923069195 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:29.731814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-897d8200-8f47-42dc-9ae4-cb4923069195 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:29.732764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-897d8200-8f47-42dc-9ae4-cb4923069195 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:29.733469 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-897d8200-8f47-42dc-9ae4-cb4923069195 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:30.040143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-897d8200-8f47-42dc-9ae4-cb4923069195 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:30.053759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-897d8200-8f47-42dc-9ae4-cb4923069195 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.338213 Aug 23 22:26:30.055843 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 123/251] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:29 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:30.466950 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8f648a6b-1413-400e-bc67-5d77f297c414 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:30.467771 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-8f648a6b-1413-400e-bc67-5d77f297c414 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:30.488977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8f648a6b-1413-400e-bc67-5d77f297c414 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:30.500014 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8f648a6b-1413-400e-bc67-5d77f297c414 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:30.503725 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8f648a6b-1413-400e-bc67-5d77f297c414 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:30.506370 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8f648a6b-1413-400e-bc67-5d77f297c414 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:30.511636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8f648a6b-1413-400e-bc67-5d77f297c414 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:30.517740 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8f648a6b-1413-400e-bc67-5d77f297c414 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:30.872358 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8f648a6b-1413-400e-bc67-5d77f297c414 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:30.886382 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8f648a6b-1413-400e-bc67-5d77f297c414 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.433131 Aug 23 22:26:30.895555 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 129/252] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:30 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:31.090815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7a1940d4-5a6d-48ad-86a1-be132ab41db8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:31.091530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7a1940d4-5a6d-48ad-86a1-be132ab41db8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:31.102076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:31.107604 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a1940d4-5a6d-48ad-86a1-be132ab41db8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:31.108512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a1940d4-5a6d-48ad-86a1-be132ab41db8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:31.109867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a1940d4-5a6d-48ad-86a1-be132ab41db8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:31.110909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a1940d4-5a6d-48ad-86a1-be132ab41db8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:31.115663 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a1940d4-5a6d-48ad-86a1-be132ab41db8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:31.116549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a1940d4-5a6d-48ad-86a1-be132ab41db8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:31.365137 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7a1940d4-5a6d-48ad-86a1-be132ab41db8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:31.375983 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7a1940d4-5a6d-48ad-86a1-be132ab41db8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.290702 Aug 23 22:26:31.390987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 124/253] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:31 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:31.908214 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3e04ca68-3df0-403e-a134-fa5c1a2a1783 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:31.910519 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3e04ca68-3df0-403e-a134-fa5c1a2a1783 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:31.949894 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e04ca68-3df0-403e-a134-fa5c1a2a1783 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:31.950699 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e04ca68-3df0-403e-a134-fa5c1a2a1783 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:31.951417 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e04ca68-3df0-403e-a134-fa5c1a2a1783 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:31.952319 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e04ca68-3df0-403e-a134-fa5c1a2a1783 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:31.954715 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e04ca68-3df0-403e-a134-fa5c1a2a1783 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:31.955364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e04ca68-3df0-403e-a134-fa5c1a2a1783 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:32.159611 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3e04ca68-3df0-403e-a134-fa5c1a2a1783 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:32.169887 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3e04ca68-3df0-403e-a134-fa5c1a2a1783 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.265533 Aug 23 22:26:32.185164 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 130/254] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:31 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:32.409593 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2242e7cb-4a84-4c1a-b2a0-9c3cc74c2f14 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:32.420957 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2242e7cb-4a84-4c1a-b2a0-9c3cc74c2f14 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:32.451273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2242e7cb-4a84-4c1a-b2a0-9c3cc74c2f14 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:32.451771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2242e7cb-4a84-4c1a-b2a0-9c3cc74c2f14 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:32.452209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2242e7cb-4a84-4c1a-b2a0-9c3cc74c2f14 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:32.466941 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2242e7cb-4a84-4c1a-b2a0-9c3cc74c2f14 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:32.467525 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2242e7cb-4a84-4c1a-b2a0-9c3cc74c2f14 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:32.467973 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2242e7cb-4a84-4c1a-b2a0-9c3cc74c2f14 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:32.508667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-9009a05d-74a8-4ef4-ac25-4b9d4684acaf req-46e8fd11-d978-47b9-ad65-0667e04dd59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc119db-5d85-487a-83e0-8356c7d8f9ca", "name": "network-vif-plugged", "status": "completed", "tag": "64695c1f-234a-4be4-a0c5-8b5936ec66f2"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:32.528062 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-9009a05d-74a8-4ef4-ac25-4b9d4684acaf req-46e8fd11-d978-47b9-ad65-0667e04dd59f service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:32.528883 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-9009a05d-74a8-4ef4-ac25-4b9d4684acaf req-46e8fd11-d978-47b9-ad65-0667e04dd59f service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:32.533639 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-9009a05d-74a8-4ef4-ac25-4b9d4684acaf req-46e8fd11-d978-47b9-ad65-0667e04dd59f service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:32.549736 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-9009a05d-74a8-4ef4-ac25-4b9d4684acaf req-46e8fd11-d978-47b9-ad65-0667e04dd59f service nova] Creating event network-vif-plugged:64695c1f-234a-4be4-a0c5-8b5936ec66f2 for instance 3cc119db-5d85-487a-83e0-8356c7d8f9ca on hv-cinder-85032 Aug 23 22:26:32.558826 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-9009a05d-74a8-4ef4-ac25-4b9d4684acaf req-46e8fd11-d978-47b9-ad65-0667e04dd59f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053662 Aug 23 22:26:32.560071 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 131/255] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:26:32.809099 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2242e7cb-4a84-4c1a-b2a0-9c3cc74c2f14 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:32.817806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2242e7cb-4a84-4c1a-b2a0-9c3cc74c2f14 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.419494 Aug 23 22:26:32.818828 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 125/256] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:32 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:33.203584 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8beb01fc-987f-496d-b2e8-5501eb18f475 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:33.204316 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-8beb01fc-987f-496d-b2e8-5501eb18f475 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:33.211392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8beb01fc-987f-496d-b2e8-5501eb18f475 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:33.212197 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8beb01fc-987f-496d-b2e8-5501eb18f475 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:33.212840 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8beb01fc-987f-496d-b2e8-5501eb18f475 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:33.213793 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8beb01fc-987f-496d-b2e8-5501eb18f475 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:33.214265 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8beb01fc-987f-496d-b2e8-5501eb18f475 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:33.214690 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8beb01fc-987f-496d-b2e8-5501eb18f475 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:33.416984 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8beb01fc-987f-496d-b2e8-5501eb18f475 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:33.429409 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8beb01fc-987f-496d-b2e8-5501eb18f475 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.238066 Aug 23 22:26:33.430459 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 132/257] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:33 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:33.846352 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-08b9dfb5-1139-4a39-9c0b-22b4907256b2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:33.848058 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-08b9dfb5-1139-4a39-9c0b-22b4907256b2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:33.858567 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08b9dfb5-1139-4a39-9c0b-22b4907256b2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:33.859260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08b9dfb5-1139-4a39-9c0b-22b4907256b2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:33.861210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08b9dfb5-1139-4a39-9c0b-22b4907256b2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:33.862125 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08b9dfb5-1139-4a39-9c0b-22b4907256b2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:33.863031 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08b9dfb5-1139-4a39-9c0b-22b4907256b2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:33.863457 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08b9dfb5-1139-4a39-9c0b-22b4907256b2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:34.043253 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-08b9dfb5-1139-4a39-9c0b-22b4907256b2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:34.054226 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-08b9dfb5-1139-4a39-9c0b-22b4907256b2 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.218620 Aug 23 22:26:34.065142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 126/258] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:33 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:34.455581 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-efd1a21f-1582-4ee4-b086-1a7e1554d9c1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:34.456862 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-efd1a21f-1582-4ee4-b086-1a7e1554d9c1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:34.464056 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-efd1a21f-1582-4ee4-b086-1a7e1554d9c1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:34.464548 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-efd1a21f-1582-4ee4-b086-1a7e1554d9c1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:34.464978 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-efd1a21f-1582-4ee4-b086-1a7e1554d9c1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:34.465808 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-efd1a21f-1582-4ee4-b086-1a7e1554d9c1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:34.466264 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-efd1a21f-1582-4ee4-b086-1a7e1554d9c1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:34.466727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-efd1a21f-1582-4ee4-b086-1a7e1554d9c1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:34.654880 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-efd1a21f-1582-4ee4-b086-1a7e1554d9c1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:34.673576 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-efd1a21f-1582-4ee4-b086-1a7e1554d9c1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.221053 Aug 23 22:26:34.675067 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 133/259] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:34 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:34.747575 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8e244a5e-09dc-4700-b48b-8520788a3799 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:34.748807 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8e244a5e-09dc-4700-b48b-8520788a3799 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:34.777904 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8e244a5e-09dc-4700-b48b-8520788a3799 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:34.781644 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8e244a5e-09dc-4700-b48b-8520788a3799 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:34.782792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8e244a5e-09dc-4700-b48b-8520788a3799 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:34.784203 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8e244a5e-09dc-4700-b48b-8520788a3799 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:34.784970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8e244a5e-09dc-4700-b48b-8520788a3799 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:34.786005 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8e244a5e-09dc-4700-b48b-8520788a3799 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:34.830655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8e244a5e-09dc-4700-b48b-8520788a3799 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/ips" status: 200 len: 146 microversion: 2.1 time: 0.092537 Aug 23 22:26:34.836200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 127/260] 10.222.0.88 () {58 vars in 1248 bytes} [Tue Aug 23 22:26:34 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/ips => generated 146 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:26:35.089653 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-16ca52ad-80db-493f-b08b-9ab5a06a8f3c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:35.090374 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-16ca52ad-80db-493f-b08b-9ab5a06a8f3c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:35.100784 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ca52ad-80db-493f-b08b-9ab5a06a8f3c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:35.101298 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ca52ad-80db-493f-b08b-9ab5a06a8f3c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:35.101921 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ca52ad-80db-493f-b08b-9ab5a06a8f3c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:35.102987 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ca52ad-80db-493f-b08b-9ab5a06a8f3c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:35.103444 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ca52ad-80db-493f-b08b-9ab5a06a8f3c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:35.104570 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ca52ad-80db-493f-b08b-9ab5a06a8f3c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:35.258118 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-16ca52ad-80db-493f-b08b-9ab5a06a8f3c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:35.269720 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-16ca52ad-80db-493f-b08b-9ab5a06a8f3c tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.185650 Aug 23 22:26:35.282290 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 134/261] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:35 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:35.696858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-aa8140f9-a746-45bb-90b9-7ccfdf42ea11 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:35.698807 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-aa8140f9-a746-45bb-90b9-7ccfdf42ea11 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:35.705484 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa8140f9-a746-45bb-90b9-7ccfdf42ea11 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:35.706133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa8140f9-a746-45bb-90b9-7ccfdf42ea11 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:35.706649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa8140f9-a746-45bb-90b9-7ccfdf42ea11 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:35.707368 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa8140f9-a746-45bb-90b9-7ccfdf42ea11 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:35.707975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa8140f9-a746-45bb-90b9-7ccfdf42ea11 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:35.708656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa8140f9-a746-45bb-90b9-7ccfdf42ea11 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:35.725996 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:35.883712 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-aa8140f9-a746-45bb-90b9-7ccfdf42ea11 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:35.892959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-aa8140f9-a746-45bb-90b9-7ccfdf42ea11 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.199738 Aug 23 22:26:35.899248 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 128/262] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:35 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:36.295898 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cc61cd84-eb19-407e-98b1-ab2c51ed9890 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:36.297045 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-cc61cd84-eb19-407e-98b1-ab2c51ed9890 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:36.308543 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc61cd84-eb19-407e-98b1-ab2c51ed9890 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:36.309116 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc61cd84-eb19-407e-98b1-ab2c51ed9890 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:36.309681 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc61cd84-eb19-407e-98b1-ab2c51ed9890 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:36.310527 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc61cd84-eb19-407e-98b1-ab2c51ed9890 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:36.310994 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc61cd84-eb19-407e-98b1-ab2c51ed9890 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:36.311442 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc61cd84-eb19-407e-98b1-ab2c51ed9890 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:36.540656 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-cc61cd84-eb19-407e-98b1-ab2c51ed9890 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:36.554314 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-cc61cd84-eb19-407e-98b1-ab2c51ed9890 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.263340 Aug 23 22:26:36.566364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 135/263] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:36 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:36.924039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5d999ac0-a2e8-4425-ab7d-c9f8bcb1091a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:36.926409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5d999ac0-a2e8-4425-ab7d-c9f8bcb1091a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:36.944132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d999ac0-a2e8-4425-ab7d-c9f8bcb1091a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:36.948931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d999ac0-a2e8-4425-ab7d-c9f8bcb1091a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:36.949940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d999ac0-a2e8-4425-ab7d-c9f8bcb1091a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:36.951413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d999ac0-a2e8-4425-ab7d-c9f8bcb1091a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:36.951883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d999ac0-a2e8-4425-ab7d-c9f8bcb1091a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:36.952312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d999ac0-a2e8-4425-ab7d-c9f8bcb1091a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:37.380460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5d999ac0-a2e8-4425-ab7d-c9f8bcb1091a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:37.403357 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5d999ac0-a2e8-4425-ab7d-c9f8bcb1091a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.485722 Aug 23 22:26:37.404375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 129/264] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:36 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:37.609165 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e312f354-e6f1-4f06-9339-54e282222dc8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:37.611566 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e312f354-e6f1-4f06-9339-54e282222dc8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:37.638570 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e312f354-e6f1-4f06-9339-54e282222dc8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:37.640928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e312f354-e6f1-4f06-9339-54e282222dc8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:37.641802 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e312f354-e6f1-4f06-9339-54e282222dc8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:37.643321 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e312f354-e6f1-4f06-9339-54e282222dc8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:37.644323 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e312f354-e6f1-4f06-9339-54e282222dc8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:37.646259 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e312f354-e6f1-4f06-9339-54e282222dc8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:37.872281 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e312f354-e6f1-4f06-9339-54e282222dc8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:37.882823 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=100 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:37.891318 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e312f354-e6f1-4f06-9339-54e282222dc8 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1314 microversion: 2.1 time: 0.298503 Aug 23 22:26:37.892839 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 136/265] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:37 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:37.994418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6d746e3e-6361-4d9f-afdb-f9db1a6d8b52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:37.995192 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6d746e3e-6361-4d9f-afdb-f9db1a6d8b52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:38.002793 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d746e3e-6361-4d9f-afdb-f9db1a6d8b52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:38.003376 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d746e3e-6361-4d9f-afdb-f9db1a6d8b52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:38.003841 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d746e3e-6361-4d9f-afdb-f9db1a6d8b52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:38.004836 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d746e3e-6361-4d9f-afdb-f9db1a6d8b52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:38.005571 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d746e3e-6361-4d9f-afdb-f9db1a6d8b52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:38.006289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d746e3e-6361-4d9f-afdb-f9db1a6d8b52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:38.039320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6d746e3e-6361-4d9f-afdb-f9db1a6d8b52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/ips" status: 200 len: 149 microversion: 2.1 time: 0.047903 Aug 23 22:26:38.041269 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 130/266] 10.222.0.88 () {58 vars in 1248 bytes} [Tue Aug 23 22:26:37 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:26:38.445356 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ee83ac28-b4be-48cd-b6b4-18e7b331dcb4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:38.445356 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ee83ac28-b4be-48cd-b6b4-18e7b331dcb4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:38.458474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ee83ac28-b4be-48cd-b6b4-18e7b331dcb4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:38.466544 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ee83ac28-b4be-48cd-b6b4-18e7b331dcb4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:38.467437 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ee83ac28-b4be-48cd-b6b4-18e7b331dcb4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:38.470394 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ee83ac28-b4be-48cd-b6b4-18e7b331dcb4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:38.471833 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ee83ac28-b4be-48cd-b6b4-18e7b331dcb4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:38.478219 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ee83ac28-b4be-48cd-b6b4-18e7b331dcb4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:38.784874 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c11c0943-f3f4-44b4-ab71-2a2ec9cdc24c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5077b40e-6b77-4352-bc6c-316d37f92f62"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:38.788976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c11c0943-f3f4-44b4-ab71-2a2ec9cdc24c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:38.820339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c11c0943-f3f4-44b4-ab71-2a2ec9cdc24c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:38.821163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c11c0943-f3f4-44b4-ab71-2a2ec9cdc24c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:38.821932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c11c0943-f3f4-44b4-ab71-2a2ec9cdc24c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:38.823469 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c11c0943-f3f4-44b4-ab71-2a2ec9cdc24c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:38.824509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c11c0943-f3f4-44b4-ab71-2a2ec9cdc24c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:38.825320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c11c0943-f3f4-44b4-ab71-2a2ec9cdc24c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:38.877423 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ee83ac28-b4be-48cd-b6b4-18e7b331dcb4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:38.898451 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ee83ac28-b4be-48cd-b6b4-18e7b331dcb4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.464036 Aug 23 22:26:38.900273 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 137/267] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:38 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:38.921770 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-fb573a8d-6598-496f-b8bd-4186ceb72a40 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:38.922545 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-fb573a8d-6598-496f-b8bd-4186ceb72a40 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:38.934043 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fb573a8d-6598-496f-b8bd-4186ceb72a40 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:38.935110 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fb573a8d-6598-496f-b8bd-4186ceb72a40 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:38.936509 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fb573a8d-6598-496f-b8bd-4186ceb72a40 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:38.937676 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fb573a8d-6598-496f-b8bd-4186ceb72a40 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:38.938376 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fb573a8d-6598-496f-b8bd-4186ceb72a40 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:38.939003 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fb573a8d-6598-496f-b8bd-4186ceb72a40 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:39.180951 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-fb573a8d-6598-496f-b8bd-4186ceb72a40 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:39.200080 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-fb573a8d-6598-496f-b8bd-4186ceb72a40 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1498 microversion: 2.1 time: 0.286086 Aug 23 22:26:39.201045 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 138/268] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:38 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1498 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:39.349350 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c11c0943-f3f4-44b4-ab71-2a2ec9cdc24c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572531 Aug 23 22:26:39.351290 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 131/269] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:26:38 2022] POST /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/os-volume_attachments => generated 194 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:26:39.630896 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-02e2497d-5b2e-4115-b486-f5a8311322bd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:39.631583 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-02e2497d-5b2e-4115-b486-f5a8311322bd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:39.639844 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-02e2497d-5b2e-4115-b486-f5a8311322bd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:39.640780 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-02e2497d-5b2e-4115-b486-f5a8311322bd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:39.654145 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-02e2497d-5b2e-4115-b486-f5a8311322bd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:39.655525 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-02e2497d-5b2e-4115-b486-f5a8311322bd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:39.656274 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-02e2497d-5b2e-4115-b486-f5a8311322bd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:39.656982 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-02e2497d-5b2e-4115-b486-f5a8311322bd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:39.694269 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-02e2497d-5b2e-4115-b486-f5a8311322bd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/ips" status: 200 len: 150 microversion: 2.20 time: 0.068592 Aug 23 22:26:39.702710 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 139/270] 10.222.0.88 () {60 vars in 1289 bytes} [Tue Aug 23 22:26:39 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/ips => generated 150 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:26:39.930069 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bc3e8064-cc4a-4540-9da8-5a9c418e7c2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:39.932686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bc3e8064-cc4a-4540-9da8-5a9c418e7c2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:39.946673 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bc3e8064-cc4a-4540-9da8-5a9c418e7c2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:39.948413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bc3e8064-cc4a-4540-9da8-5a9c418e7c2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:39.949188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bc3e8064-cc4a-4540-9da8-5a9c418e7c2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:39.950699 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bc3e8064-cc4a-4540-9da8-5a9c418e7c2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:39.951753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bc3e8064-cc4a-4540-9da8-5a9c418e7c2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:39.953003 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bc3e8064-cc4a-4540-9da8-5a9c418e7c2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:40.204547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-bc3e8064-cc4a-4540-9da8-5a9c418e7c2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:40.218936 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bc3e8064-cc4a-4540-9da8-5a9c418e7c2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.300872 Aug 23 22:26:40.233830 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 132/271] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:39 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:40.363392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-633a3b9a-c488-4d85-9a06-02c9e1a9066e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ee963ed-e796-413c-9a1f-054ac0cb350a"}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:40.367521 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-633a3b9a-c488-4d85-9a06-02c9e1a9066e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:40.375238 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-633a3b9a-c488-4d85-9a06-02c9e1a9066e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:40.376011 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-633a3b9a-c488-4d85-9a06-02c9e1a9066e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:40.376456 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-633a3b9a-c488-4d85-9a06-02c9e1a9066e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:40.377671 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-633a3b9a-c488-4d85-9a06-02c9e1a9066e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:40.378154 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-633a3b9a-c488-4d85-9a06-02c9e1a9066e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:40.378915 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-633a3b9a-c488-4d85-9a06-02c9e1a9066e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:41.125783 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4b6ea427-d605-4748-9135-f5f1c5946971 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Action: 'create', calling method: .version_select at 0x7f902c40d310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2063591735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfJf8Yndphe6dl43g6F2YU8bZUuO5svaQPB5hfOjxMMpHnC3Nk0CQWT7wtQnoAWWXpm8pRD8sz5WAXgSVI3ihP27w2xA9yo3XpvvJQnuMw2q+OsvwfmGanVtEgZIND0+Q=="}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:41.142161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-4b6ea427-d605-4748-9135-f5f1c5946971 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Getting quotas for project 2cfc99aa2ea246fb845d429885ff5209. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:26:41.146208 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-4b6ea427-d605-4748-9135-f5f1c5946971 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Getting quotas for user eb81364013af425e9956dd09ceb150e6 and project 2cfc99aa2ea246fb845d429885ff5209. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:26:41.172114 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4b6ea427-d605-4748-9135-f5f1c5946971 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050571 Aug 23 22:26:41.172717 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 133/272] 10.222.0.88 () {60 vars in 1159 bytes} [Tue Aug 23 22:26:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:26:41.227979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1047829720", "imageRef": "5bf23594-8aaf-4bab-a543-24f4e2c8f047", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2063591735", "networks": [{"uuid": "ffa6addb-18b1-4758-90d8-b21ba7a6d789"}]}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:41.288257 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] validate_networks() for [('ffa6addb-18b1-4758-90d8-b21ba7a6d789', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:26:41.529558 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-633a3b9a-c488-4d85-9a06-02c9e1a9066e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.168808 Aug 23 22:26:41.533542 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 140/273] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:26:40 2022] POST /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments => generated 194 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:26:41.545169 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-6b081d64-1a23-4c25-ab41-adf728bcbc40 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:41.547002 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-6b081d64-1a23-4c25-ab41-adf728bcbc40 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:41.564663 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:41.569284 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6b081d64-1a23-4c25-ab41-adf728bcbc40 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:41.570472 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6b081d64-1a23-4c25-ab41-adf728bcbc40 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:41.571480 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6b081d64-1a23-4c25-ab41-adf728bcbc40 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:41.574673 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6b081d64-1a23-4c25-ab41-adf728bcbc40 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:41.575864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6b081d64-1a23-4c25-ab41-adf728bcbc40 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:41.577026 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6b081d64-1a23-4c25-ab41-adf728bcbc40 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:41.830835 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-6b081d64-1a23-4c25-ab41-adf728bcbc40 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:41.844534 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-6b081d64-1a23-4c25-ab41-adf728bcbc40 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.308463 Aug 23 22:26:41.845649 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 141/274] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:41 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:41.855249 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-03fc16a4-5e3e-4b93-8fa4-c78e1afaa15f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:41.856457 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-03fc16a4-5e3e-4b93-8fa4-c78e1afaa15f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:41.867986 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-03fc16a4-5e3e-4b93-8fa4-c78e1afaa15f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:41.869755 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-03fc16a4-5e3e-4b93-8fa4-c78e1afaa15f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:41.870835 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-03fc16a4-5e3e-4b93-8fa4-c78e1afaa15f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:41.872434 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-03fc16a4-5e3e-4b93-8fa4-c78e1afaa15f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:41.873555 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-03fc16a4-5e3e-4b93-8fa4-c78e1afaa15f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:41.874079 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-03fc16a4-5e3e-4b93-8fa4-c78e1afaa15f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:41.906173 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-03fc16a4-5e3e-4b93-8fa4-c78e1afaa15f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Going to try to terminate instance {{(pid=120855) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:26:41.995254 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:26:41.995727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:26:41.996461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:26:41.996999 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:26:41.997475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:26:42.008987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:42.009542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:42.010620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:42.011712 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:42.012092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:42.012499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:42.038928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-03fc16a4-5e3e-4b93-8fa4-c78e1afaa15f tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 204 len: 0 microversion: 2.1 time: 0.191227 Aug 23 22:26:42.039532 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 142/275] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:26:41 2022] DELETE /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:26:42.039734 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Getting quotas for project 2cfc99aa2ea246fb845d429885ff5209. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:26:42.048462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Getting quotas for user eb81364013af425e9956dd09ceb150e6 and project 2cfc99aa2ea246fb845d429885ff5209. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:26:42.048664 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3caa917b-6003-441b-86c7-29a59c0c18c4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:42.049392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3caa917b-6003-441b-86c7-29a59c0c18c4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:42.056489 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3caa917b-6003-441b-86c7-29a59c0c18c4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:42.057551 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3caa917b-6003-441b-86c7-29a59c0c18c4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:42.057991 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3caa917b-6003-441b-86c7-29a59c0c18c4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:42.058709 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3caa917b-6003-441b-86c7-29a59c0c18c4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:42.059163 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3caa917b-6003-441b-86c7-29a59c0c18c4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:42.059581 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3caa917b-6003-441b-86c7-29a59c0c18c4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:42.070549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:26:42.076418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5bf23594-8aaf-4bab-a543-24f4e2c8f047',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:26:42.170267 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-067ab974-b365-4c4b-b949-2ebfd075cf58 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945810 Aug 23 22:26:42.172084 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 134/276] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:26:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:26:42.194570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e0ba0855-31bc-4bd2-a82b-9c92ed51b527 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:42.196310 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e0ba0855-31bc-4bd2-a82b-9c92ed51b527 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:42.232455 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3caa917b-6003-441b-86c7-29a59c0c18c4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:42.241197 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3caa917b-6003-441b-86c7-29a59c0c18c4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1504 microversion: 2.1 time: 0.196738 Aug 23 22:26:42.241774 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 143/277] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:42 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:42.288329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e0ba0855-31bc-4bd2-a82b-9c92ed51b527 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:42.312369 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e0ba0855-31bc-4bd2-a82b-9c92ed51b527 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1259 microversion: 2.1 time: 0.128721 Aug 23 22:26:42.313143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 135/278] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:42 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1259 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:42.882935 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-22b8db2f-ee98-451a-9dd0-b3934d9b8062 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:42.883998 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-22b8db2f-ee98-451a-9dd0-b3934d9b8062 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:42.893779 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-22b8db2f-ee98-451a-9dd0-b3934d9b8062 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:42.894566 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-22b8db2f-ee98-451a-9dd0-b3934d9b8062 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:42.895253 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-22b8db2f-ee98-451a-9dd0-b3934d9b8062 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:42.896159 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-22b8db2f-ee98-451a-9dd0-b3934d9b8062 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:42.896990 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-22b8db2f-ee98-451a-9dd0-b3934d9b8062 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:42.897765 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-22b8db2f-ee98-451a-9dd0-b3934d9b8062 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:42.950442 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-de37c05b-0f99-4e68-940f-84f2318bc33a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:42.951018 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-de37c05b-0f99-4e68-940f-84f2318bc33a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:42.957684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-de37c05b-0f99-4e68-940f-84f2318bc33a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:42.958872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-de37c05b-0f99-4e68-940f-84f2318bc33a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:42.958872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-de37c05b-0f99-4e68-940f-84f2318bc33a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:42.959350 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-de37c05b-0f99-4e68-940f-84f2318bc33a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:42.959829 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-de37c05b-0f99-4e68-940f-84f2318bc33a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:42.960227 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-de37c05b-0f99-4e68-940f-84f2318bc33a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:42.987147 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-de37c05b-0f99-4e68-940f-84f2318bc33a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lazy-loading 'flavor' on Instance uuid 80b697da-19f2-459e-a57e-e386523e4bcf {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:26:43.107502 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-22b8db2f-ee98-451a-9dd0-b3934d9b8062 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:43.122214 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-22b8db2f-ee98-451a-9dd0-b3934d9b8062 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.244230 Aug 23 22:26:43.123395 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 144/279] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:42 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:43.256166 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-de37c05b-0f99-4e68-940f-84f2318bc33a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "POST /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/action" status: 202 len: 0 microversion: 2.20 time: 0.308460 Aug 23 22:26:43.256166 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 136/280] 10.222.0.88 () {62 vars in 1319 bytes} [Tue Aug 23 22:26:42 2022] POST /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:26:43.273560 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:43.274392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-482cd696-4fa5-475c-ae85-68468951a7a5 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:43.274700 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:43.275361 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-482cd696-4fa5-475c-ae85-68468951a7a5 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:43.288081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:43.289523 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:43.290695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:43.292343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-482cd696-4fa5-475c-ae85-68468951a7a5 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:43.293337 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-482cd696-4fa5-475c-ae85-68468951a7a5 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:43.293629 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:43.294335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-482cd696-4fa5-475c-ae85-68468951a7a5 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:43.294530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:43.294882 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:43.295823 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-482cd696-4fa5-475c-ae85-68468951a7a5 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:43.297085 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-482cd696-4fa5-475c-ae85-68468951a7a5 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:43.298237 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-482cd696-4fa5-475c-ae85-68468951a7a5 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:43.543224 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-482cd696-4fa5-475c-ae85-68468951a7a5 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:43.552509 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-482cd696-4fa5-475c-ae85-68468951a7a5 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1504 microversion: 2.1 time: 0.286010 Aug 23 22:26:43.552778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:43.554556 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 145/281] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:43 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:43.564584 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a1c9e2f3-ef7b-4ae9-bd11-50eef3758eaf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:43.566558 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a1c9e2f3-ef7b-4ae9-bd11-50eef3758eaf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:43.578610 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1c9e2f3-ef7b-4ae9-bd11-50eef3758eaf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:43.580025 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1c9e2f3-ef7b-4ae9-bd11-50eef3758eaf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:43.581247 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1c9e2f3-ef7b-4ae9-bd11-50eef3758eaf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:43.583031 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1c9e2f3-ef7b-4ae9-bd11-50eef3758eaf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:43.584078 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1c9e2f3-ef7b-4ae9-bd11-50eef3758eaf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:43.585002 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1c9e2f3-ef7b-4ae9-bd11-50eef3758eaf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:43.589432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:43.591946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:43.594164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a3219863-90d3-4010-9300-b38d07bd5db3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.328037 Aug 23 22:26:43.595558 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 137/282] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:43 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:26:43.701238 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a1c9e2f3-ef7b-4ae9-bd11-50eef3758eaf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:43.712719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a1c9e2f3-ef7b-4ae9-bd11-50eef3758eaf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1263 microversion: 2.1 time: 0.156028 Aug 23 22:26:43.713786 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 146/283] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:43 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:44.150004 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3828933b-e19a-40de-9901-5a49c0e23bfc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:44.151653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3828933b-e19a-40de-9901-5a49c0e23bfc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:44.162207 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3828933b-e19a-40de-9901-5a49c0e23bfc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:44.162801 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3828933b-e19a-40de-9901-5a49c0e23bfc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:44.163327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3828933b-e19a-40de-9901-5a49c0e23bfc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:44.164177 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3828933b-e19a-40de-9901-5a49c0e23bfc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:44.164648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3828933b-e19a-40de-9901-5a49c0e23bfc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:44.165198 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3828933b-e19a-40de-9901-5a49c0e23bfc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:44.401590 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3828933b-e19a-40de-9901-5a49c0e23bfc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:44.418628 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3828933b-e19a-40de-9901-5a49c0e23bfc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.275645 Aug 23 22:26:44.420811 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 138/284] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:44 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:44.591746 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-9bda8ade-d6b9-4fd1-9108-647c6542406a tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:44.592626 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9bda8ade-d6b9-4fd1-9108-647c6542406a tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:44.612616 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bda8ade-d6b9-4fd1-9108-647c6542406a tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:44.613677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bda8ade-d6b9-4fd1-9108-647c6542406a tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:44.614435 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bda8ade-d6b9-4fd1-9108-647c6542406a tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:44.615802 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bda8ade-d6b9-4fd1-9108-647c6542406a tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:44.616868 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bda8ade-d6b9-4fd1-9108-647c6542406a tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:44.617681 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bda8ade-d6b9-4fd1-9108-647c6542406a tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:44.629419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:44.630572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:44.643444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:44.644483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:44.645264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:44.646532 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:44.647404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:44.648231 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:44.840030 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9bda8ade-d6b9-4fd1-9108-647c6542406a tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:44.850577 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-9bda8ade-d6b9-4fd1-9108-647c6542406a tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1504 microversion: 2.1 time: 0.263429 Aug 23 22:26:44.851201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 147/285] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:44 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:44.857302 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ab932ce5-7ebb-4bb7-bef0-e35e07e35c1d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:44.858058 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ab932ce5-7ebb-4bb7-bef0-e35e07e35c1d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:44.873364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ab932ce5-7ebb-4bb7-bef0-e35e07e35c1d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:44.874049 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ab932ce5-7ebb-4bb7-bef0-e35e07e35c1d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:44.874493 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ab932ce5-7ebb-4bb7-bef0-e35e07e35c1d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:44.875404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ab932ce5-7ebb-4bb7-bef0-e35e07e35c1d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:44.875967 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ab932ce5-7ebb-4bb7-bef0-e35e07e35c1d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:44.876415 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ab932ce5-7ebb-4bb7-bef0-e35e07e35c1d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:44.974007 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ab932ce5-7ebb-4bb7-bef0-e35e07e35c1d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:44.985371 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ab932ce5-7ebb-4bb7-bef0-e35e07e35c1d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1311 microversion: 2.1 time: 0.132857 Aug 23 22:26:44.986302 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 148/286] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:44 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1311 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:45.046988 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:45.063488 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:45.066179 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:45.067938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-970f3682-db75-4750-8e6e-65adb717512b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.446732 Aug 23 22:26:45.069730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 139/287] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:44 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:26:45.320835 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-08b701b9-e0c1-43c3-9f0f-5644baae09f0 req-5755e44d-f24b-4b25-a924-1ec4a7348eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc119db-5d85-487a-83e0-8356c7d8f9ca", "name": "network-vif-deleted", "tag": "64695c1f-234a-4be4-a0c5-8b5936ec66f2"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:45.335928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-08b701b9-e0c1-43c3-9f0f-5644baae09f0 req-5755e44d-f24b-4b25-a924-1ec4a7348eba service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:45.336721 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-08b701b9-e0c1-43c3-9f0f-5644baae09f0 req-5755e44d-f24b-4b25-a924-1ec4a7348eba service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:45.337392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-08b701b9-e0c1-43c3-9f0f-5644baae09f0 req-5755e44d-f24b-4b25-a924-1ec4a7348eba service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:45.353413 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-08b701b9-e0c1-43c3-9f0f-5644baae09f0 req-5755e44d-f24b-4b25-a924-1ec4a7348eba service nova] Creating event network-vif-deleted:64695c1f-234a-4be4-a0c5-8b5936ec66f2 for instance 3cc119db-5d85-487a-83e0-8356c7d8f9ca on hv-cinder-85032 Aug 23 22:26:45.359230 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-08b701b9-e0c1-43c3-9f0f-5644baae09f0 req-5755e44d-f24b-4b25-a924-1ec4a7348eba service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044311 Aug 23 22:26:45.360227 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 149/288] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:26:45.451325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a729a21a-cd7b-4e85-b584-9745628790b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:45.452395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a729a21a-cd7b-4e85-b584-9745628790b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:45.464714 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a729a21a-cd7b-4e85-b584-9745628790b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:45.465578 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a729a21a-cd7b-4e85-b584-9745628790b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:45.466316 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a729a21a-cd7b-4e85-b584-9745628790b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:45.467548 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a729a21a-cd7b-4e85-b584-9745628790b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:45.468342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a729a21a-cd7b-4e85-b584-9745628790b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:45.469121 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a729a21a-cd7b-4e85-b584-9745628790b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:45.775941 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a729a21a-cd7b-4e85-b584-9745628790b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:45.786715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a729a21a-cd7b-4e85-b584-9745628790b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.342801 Aug 23 22:26:45.787342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 140/289] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:45 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:45.885387 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d077d1ee-e18c-4602-ada1-ec425f53a515 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:45.889090 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d077d1ee-e18c-4602-ada1-ec425f53a515 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:45.905045 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d077d1ee-e18c-4602-ada1-ec425f53a515 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:45.905782 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d077d1ee-e18c-4602-ada1-ec425f53a515 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:45.906408 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d077d1ee-e18c-4602-ada1-ec425f53a515 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:45.907413 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d077d1ee-e18c-4602-ada1-ec425f53a515 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:45.908040 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d077d1ee-e18c-4602-ada1-ec425f53a515 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:45.908611 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d077d1ee-e18c-4602-ada1-ec425f53a515 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:46.018403 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d077d1ee-e18c-4602-ada1-ec425f53a515 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:46.028606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-750953e6-5d2f-4d1c-88c0-c0b9d2f73cfc tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:46.028606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-750953e6-5d2f-4d1c-88c0-c0b9d2f73cfc tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:46.036083 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d077d1ee-e18c-4602-ada1-ec425f53a515 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1299 microversion: 2.1 time: 0.157372 Aug 23 22:26:46.036907 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 150/290] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:45 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1299 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:46.038945 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-750953e6-5d2f-4d1c-88c0-c0b9d2f73cfc tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:46.039591 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-750953e6-5d2f-4d1c-88c0-c0b9d2f73cfc tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:46.040184 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-750953e6-5d2f-4d1c-88c0-c0b9d2f73cfc tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:46.041724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-750953e6-5d2f-4d1c-88c0-c0b9d2f73cfc tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:46.042910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-750953e6-5d2f-4d1c-88c0-c0b9d2f73cfc tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:46.043843 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-750953e6-5d2f-4d1c-88c0-c0b9d2f73cfc tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:46.112380 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:46.116778 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:46.146507 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:46.148740 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:46.150209 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:46.156110 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:46.160893 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:46.162858 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:46.252416 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:46.345273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-750953e6-5d2f-4d1c-88c0-c0b9d2f73cfc tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:46.357329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-750953e6-5d2f-4d1c-88c0-c0b9d2f73cfc tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1311 microversion: 2.1 time: 0.337060 Aug 23 22:26:46.358409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 141/291] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:46 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1311 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:46.426442 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:46.439901 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:46.442730 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:46.444817 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d26b745f-3801-4147-91bd-d7aa32d2ba1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.341255 Aug 23 22:26:46.452055 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 151/292] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:46 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:26:46.821730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c4a369b4-84b1-46db-9ff2-74e4f07be314 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:46.822881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c4a369b4-84b1-46db-9ff2-74e4f07be314 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:46.836834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c4a369b4-84b1-46db-9ff2-74e4f07be314 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:46.838340 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c4a369b4-84b1-46db-9ff2-74e4f07be314 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:46.839201 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c4a369b4-84b1-46db-9ff2-74e4f07be314 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:46.840756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c4a369b4-84b1-46db-9ff2-74e4f07be314 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:46.844475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c4a369b4-84b1-46db-9ff2-74e4f07be314 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:46.845304 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c4a369b4-84b1-46db-9ff2-74e4f07be314 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:47.073425 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:47.073425 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:47.081726 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:47.082707 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:47.083357 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:47.084970 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:47.086273 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:47.087058 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:47.107450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c4a369b4-84b1-46db-9ff2-74e4f07be314 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:47.123818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c4a369b4-84b1-46db-9ff2-74e4f07be314 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.308518 Aug 23 22:26:47.124907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 142/293] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:46 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:47.165650 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:47.167058 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:47.168036 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:47.169163 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.objects.instance [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lazy-loading 'fault' on Instance uuid 3cc119db-5d85-487a-83e0-8356c7d8f9ca {{(pid=120855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:26:47.269856 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba49197c9a3446b68bc92c48abf57b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5196561b7ae4adbb110ce06e81401f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:47.285258 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-b4682693-568e-485d-a85d-5ea23ee3daf4 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 200 len: 1304 microversion: 2.1 time: 0.224487 Aug 23 22:26:47.285793 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 152/294] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:47 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 1304 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:47.385973 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-63d10614-4df3-4d6b-9697-34e318ae5f06 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:47.387038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-63d10614-4df3-4d6b-9697-34e318ae5f06 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:47.412346 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-63d10614-4df3-4d6b-9697-34e318ae5f06 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:47.413808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-63d10614-4df3-4d6b-9697-34e318ae5f06 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:47.414898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-63d10614-4df3-4d6b-9697-34e318ae5f06 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:47.416527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-63d10614-4df3-4d6b-9697-34e318ae5f06 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:47.417558 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-63d10614-4df3-4d6b-9697-34e318ae5f06 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:47.418730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-63d10614-4df3-4d6b-9697-34e318ae5f06 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:47.474968 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:47.476667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:47.490247 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:47.491894 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:47.493312 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:47.495119 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:47.496797 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:47.498632 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:47.582770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-63d10614-4df3-4d6b-9697-34e318ae5f06 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:47.610779 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-63d10614-4df3-4d6b-9697-34e318ae5f06 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1317 microversion: 2.1 time: 0.230590 Aug 23 22:26:47.612969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 143/295] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:47 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:47.847816 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:47.867940 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:47.872542 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:47.875578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-c2c8c84e-25ff-4739-96e3-b10aa165f924 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.409395 Aug 23 22:26:47.894231 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 153/296] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:47 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:26:48.161998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-653c0573-792e-414a-a4ba-e1f92cde3725 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:48.164023 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-653c0573-792e-414a-a4ba-e1f92cde3725 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:48.176670 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-653c0573-792e-414a-a4ba-e1f92cde3725 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:48.177583 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-653c0573-792e-414a-a4ba-e1f92cde3725 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:48.178605 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-653c0573-792e-414a-a4ba-e1f92cde3725 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:48.179872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-653c0573-792e-414a-a4ba-e1f92cde3725 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:48.180901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-653c0573-792e-414a-a4ba-e1f92cde3725 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:48.182069 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-653c0573-792e-414a-a4ba-e1f92cde3725 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:48.325406 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:48.326652 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] [instance: 3cc119db-5d85-487a-83e0-8356c7d8f9ca] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:48.334741 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:48.335551 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:48.336086 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:48.337010 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:48.338677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:48.339312 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:48.367721 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.wsgi [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] HTTP exception thrown: Instance 3cc119db-5d85-487a-83e0-8356c7d8f9ca could not be found. Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Request method failure captured: Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: request: GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca HTTP/1.1 Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept: application/json Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept-Encoding: identity Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Connection: close Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Length: 0 Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Type: application/json Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Host: 10.222.0.88 Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Openstack-System-Scope: None Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: User-Agent: python-urllib3/1.26.11 Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Auth-Token: gAAAAABjBVPgfymDEhTxYnAcj-YGB1LzfQP0gfSVkitN5mmxEhfhNx9V3Oxcl9_44_0j6RM6KmavLtWoGjy3lUiqqSxTRfki2weNdpxxJoBfIuqOs-8pRf32_oXdceImrJLP4InmiVLlJBh7W4kyyqnK3Gsa6IxXvBBT5nJwsfg2HM886VJVfbw Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Id: None Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Name: None Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Identity-Status: Confirmed Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Is-Admin-Project: True Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Id: default Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Name: Default Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Id: e5196561b7ae4adbb110ce06e81401f7 Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Name: tempest-VolumesActionsTest-421002477 Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Role: member,reader Aug 23 22:26:48.371864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Roles: member,reader Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e5196561b7ae4adbb110ce06e81401f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e5196561b7ae4adbb110ce06e81401f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e5196561b7ae4adbb110ce06e81401f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e5196561b7ae4adbb110ce06e81401f7"}]}] Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant: tempest-VolumesActionsTest-421002477 Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Id: e5196561b7ae4adbb110ce06e81401f7 Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Name: tempest-VolumesActionsTest-421002477 Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User: tempest-VolumesActionsTest-421002477-project Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Id: default Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Name: Default Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Id: ba49197c9a3446b68bc92c48abf57b37 Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Name: tempest-VolumesActionsTest-421002477-project Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: method: > Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: exception: Instance 3cc119db-5d85-487a-83e0-8356c7d8f9ca could not be found. Aug 23 22:26:48.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: action_args: {'id': '3cc119db-5d85-487a-83e0-8356c7d8f9ca'} Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc119db-5d85-487a-83e0-8356c7d8f9ca could not be found. Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:26:48.376254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc119db-5d85-487a-83e0-8356c7d8f9ca could not be found. Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc119db-5d85-487a-83e0-8356c7d8f9ca could not be found. Aug 23 22:26:48.379853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:48.382012 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] Returning 404 to user: Instance 3cc119db-5d85-487a-83e0-8356c7d8f9ca could not be found. {{(pid=120855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:26:48.382012 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-2730e689-7c9f-4305-a7db-decc38ced400 tempest-VolumesActionsTest-421002477 tempest-VolumesActionsTest-421002477-project] 10.222.0.88 "GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca" status: 404 len: 111 microversion: 2.1 time: 0.054690 Aug 23 22:26:48.382012 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 154/297] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:48 2022] GET /compute/v2.1/servers/3cc119db-5d85-487a-83e0-8356c7d8f9ca => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:26:48.523625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-653c0573-792e-414a-a4ba-e1f92cde3725 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:48.532070 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:48.560420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-653c0573-792e-414a-a4ba-e1f92cde3725 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.405193 Aug 23 22:26:48.563720 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 144/298] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:48 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:48.657538 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-481c4439-79dd-4865-894e-234cea3381a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:48.669174 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-481c4439-79dd-4865-894e-234cea3381a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:48.699896 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-481c4439-79dd-4865-894e-234cea3381a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:48.701195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-481c4439-79dd-4865-894e-234cea3381a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:48.702403 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-481c4439-79dd-4865-894e-234cea3381a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:48.704086 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-481c4439-79dd-4865-894e-234cea3381a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:48.705350 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-481c4439-79dd-4865-894e-234cea3381a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:48.706745 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-481c4439-79dd-4865-894e-234cea3381a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:48.930094 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-481c4439-79dd-4865-894e-234cea3381a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:48.945583 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-481c4439-79dd-4865-894e-234cea3381a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1317 microversion: 2.1 time: 0.298422 Aug 23 22:26:48.948788 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 155/299] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:48 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:48.957246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:48.968198 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:49.003940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:49.004932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:49.005874 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:49.008289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:49.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:49.012819 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:49.602938 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-06d861c7-40d9-4963-987b-1b30a89fd68d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:49.604387 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-06d861c7-40d9-4963-987b-1b30a89fd68d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:49.615559 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-06d861c7-40d9-4963-987b-1b30a89fd68d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:49.620108 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-06d861c7-40d9-4963-987b-1b30a89fd68d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:49.621115 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-06d861c7-40d9-4963-987b-1b30a89fd68d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:49.626082 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-06d861c7-40d9-4963-987b-1b30a89fd68d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:49.627136 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-06d861c7-40d9-4963-987b-1b30a89fd68d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:49.628192 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-06d861c7-40d9-4963-987b-1b30a89fd68d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:49.989809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:50.005684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:50.011664 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:50.013408 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-abc12263-4a17-493e-a361-875b440c9c18 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 1.088764 Aug 23 22:26:50.016498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 145/300] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:48 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:26:50.039304 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f76d268d-0f41-4839-bfb9-8f4d67aa1287 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:50.040622 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f76d268d-0f41-4839-bfb9-8f4d67aa1287 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:50.050160 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f76d268d-0f41-4839-bfb9-8f4d67aa1287 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:50.051196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f76d268d-0f41-4839-bfb9-8f4d67aa1287 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:50.052200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f76d268d-0f41-4839-bfb9-8f4d67aa1287 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:50.053434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f76d268d-0f41-4839-bfb9-8f4d67aa1287 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:50.054214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f76d268d-0f41-4839-bfb9-8f4d67aa1287 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:50.054868 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f76d268d-0f41-4839-bfb9-8f4d67aa1287 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:50.079364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-06d861c7-40d9-4963-987b-1b30a89fd68d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:50.096340 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-06d861c7-40d9-4963-987b-1b30a89fd68d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1501 microversion: 2.1 time: 0.498185 Aug 23 22:26:50.098953 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 156/301] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:49 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1501 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:50.149116 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9e56474-45d0-4eba-bd69-323cf01d43cf"}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:50.161862 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:50.202928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:50.203431 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:50.204070 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:50.209840 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:50.210386 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:50.217808 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:50.383292 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.wsgi [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] HTTP exception thrown: Cannot 'attach_volume' instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 while it is in vm_state rescued Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Request method failure captured: Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: request: POST /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025/os-volume_attachments HTTP/1.1 Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept: application/json Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept-Encoding: identity Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Connection: close Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Length: 74 Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Type: application/json Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Host: 10.222.0.88 Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Openstack-System-Scope: None Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: User-Agent: python-urllib3/1.26.11 Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Auth-Token: gAAAAABjBVOv13_MU_50s_aHvDIST8LDnTZeNLrXoKO_9tRpymYOQxPByczIdikrorzz5bnQJNXBXY2DsLSgLVa6dVPKD_ZD2k345A6vw_H8htZmqauzwSRk2seRexlxlvlsqvtICY93c2IqIF6AlW97HMPeU9BZNrOrD_PqMIc0CmBjXZp0CDg Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Id: None Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Name: None Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Identity-Status: Confirmed Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Is-Admin-Project: True Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Id: default Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Name: Default Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Id: 1dfc84dc05d542d987194096f3b7e51a Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Role: member,reader Aug 23 22:26:50.390041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Roles: member,reader Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1dfc84dc05d542d987194096f3b7e51a"}]}] Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Id: 1dfc84dc05d542d987194096f3b7e51a Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User: tempest-ServerRescueNegativeTestJSON-146746916-project Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Id: default Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Name: Default Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Id: 78b05a538ce0466ea8b3e27a0a6fc162 Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Name: tempest-ServerRescueNegativeTestJSON-146746916-project Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: {"volumeAttachment": {"volumeId": "c9e56474-45d0-4eba-bd69-323cf01d43cf"}} Aug 23 22:26:50.391343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: method: > Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: exception: Cannot 'attach_volume' instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 while it is in vm_state rescued Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: action_args: {'server_id': '498d6e2f-6d66-4925-8f7c-eca5b08c1025', 'body': {'volumeAttachment': {'volumeId': 'c9e56474-45d0-4eba-bd69-323cf01d43cf'}}} Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:26:50.392139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 while it is in vm_state rescued Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:26:50.393246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:26:50.394449 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:26:50.394449 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:26:50.394449 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 while it is in vm_state rescued Aug 23 22:26:50.394449 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:26:50.403826 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Returning 409 to user: Cannot 'attach_volume' instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 while it is in vm_state rescued {{(pid=120855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:26:50.410260 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-01abef21-8dd1-41e0-a15a-a5f70229dcc9 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.271704 Aug 23 22:26:50.414917 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 157/302] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:26:50 2022] POST /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025/os-volume_attachments => generated 152 bytes in 278 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 22:26:50.442997 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-f4e6365d-c393-4f65-9d81-7a874ccd7dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:50.450877 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-f4e6365d-c393-4f65-9d81-7a874ccd7dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:50.481896 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f4e6365d-c393-4f65-9d81-7a874ccd7dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:50.483643 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f4e6365d-c393-4f65-9d81-7a874ccd7dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:50.489689 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f4e6365d-c393-4f65-9d81-7a874ccd7dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:50.490801 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f4e6365d-c393-4f65-9d81-7a874ccd7dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:50.492173 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f4e6365d-c393-4f65-9d81-7a874ccd7dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:50.493125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f4e6365d-c393-4f65-9d81-7a874ccd7dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:50.709536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-f4e6365d-c393-4f65-9d81-7a874ccd7dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025/action" status: 202 len: 0 microversion: 2.1 time: 0.286872 Aug 23 22:26:50.725845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 158/303] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:26:50 2022] POST /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:26:50.741461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d5e6d607-6515-4804-85a6-17e951b65103 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:50.742596 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d5e6d607-6515-4804-85a6-17e951b65103 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:50.773913 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d5e6d607-6515-4804-85a6-17e951b65103 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:50.781286 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d5e6d607-6515-4804-85a6-17e951b65103 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:50.784246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d5e6d607-6515-4804-85a6-17e951b65103 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:50.788539 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d5e6d607-6515-4804-85a6-17e951b65103 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:50.789745 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d5e6d607-6515-4804-85a6-17e951b65103 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:50.790845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d5e6d607-6515-4804-85a6-17e951b65103 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:50.834621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f76d268d-0f41-4839-bfb9-8f4d67aa1287 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:50.854212 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f76d268d-0f41-4839-bfb9-8f4d67aa1287 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.825239 Aug 23 22:26:50.855097 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 146/304] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:50 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:51.058033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:51.061259 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:51.113810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:51.114812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:51.115581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:51.116698 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:51.117547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:51.119943 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:51.253867 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d5e6d607-6515-4804-85a6-17e951b65103 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:51.284703 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d5e6d607-6515-4804-85a6-17e951b65103 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.556074 Aug 23 22:26:51.286585 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 159/305] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:50 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:51.309487 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-008d0178-56d7-49e6-b65d-e9f51cbdb0e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:51.317679 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-008d0178-56d7-49e6-b65d-e9f51cbdb0e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:51.318442 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-008d0178-56d7-49e6-b65d-e9f51cbdb0e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:51.319280 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-008d0178-56d7-49e6-b65d-e9f51cbdb0e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:51.397910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-008d0178-56d7-49e6-b65d-e9f51cbdb0e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Going to try to stop instance {{(pid=120855) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 22:26:51.522277 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-008d0178-56d7-49e6-b65d-e9f51cbdb0e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/action" status: 202 len: 0 microversion: 2.1 time: 0.217513 Aug 23 22:26:51.531864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 160/306] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:26:51 2022] POST /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:26:51.543937 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-20ab8d93-bf15-4321-b0ae-791ec6e5623f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:51.545392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-20ab8d93-bf15-4321-b0ae-791ec6e5623f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:51.553928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-20ab8d93-bf15-4321-b0ae-791ec6e5623f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:51.554627 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-20ab8d93-bf15-4321-b0ae-791ec6e5623f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:51.555232 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-20ab8d93-bf15-4321-b0ae-791ec6e5623f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:51.556418 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-20ab8d93-bf15-4321-b0ae-791ec6e5623f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:51.557269 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-20ab8d93-bf15-4321-b0ae-791ec6e5623f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:51.557847 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-20ab8d93-bf15-4321-b0ae-791ec6e5623f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:51.945883 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-20ab8d93-bf15-4321-b0ae-791ec6e5623f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:51.959490 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-20ab8d93-bf15-4321-b0ae-791ec6e5623f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.425173 Aug 23 22:26:51.960657 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 161/307] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:51 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:51.966353 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-aa2bacfa-b497-42aa-bf4a-89bf3e17b852 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:51.967216 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-aa2bacfa-b497-42aa-bf4a-89bf3e17b852 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:51.974315 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-aa2bacfa-b497-42aa-bf4a-89bf3e17b852 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:51.975125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-aa2bacfa-b497-42aa-bf4a-89bf3e17b852 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:51.975580 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-aa2bacfa-b497-42aa-bf4a-89bf3e17b852 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:51.976353 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-aa2bacfa-b497-42aa-bf4a-89bf3e17b852 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:51.976805 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-aa2bacfa-b497-42aa-bf4a-89bf3e17b852 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:51.977478 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-aa2bacfa-b497-42aa-bf4a-89bf3e17b852 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:52.021200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:52.281649 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-aa2bacfa-b497-42aa-bf4a-89bf3e17b852 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:52.293091 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=12 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:52.293943 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-aa2bacfa-b497-42aa-bf4a-89bf3e17b852 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.330276 Aug 23 22:26:52.310627 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 162/308] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:51 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:52.363489 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ca243a92-8a16-4633-a171-983fe4bdf939 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:52.365517 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ca243a92-8a16-4633-a171-983fe4bdf939 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:52.378332 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca243a92-8a16-4633-a171-983fe4bdf939 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:52.379135 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca243a92-8a16-4633-a171-983fe4bdf939 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:52.380360 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca243a92-8a16-4633-a171-983fe4bdf939 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:52.390425 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca243a92-8a16-4633-a171-983fe4bdf939 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:52.391220 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca243a92-8a16-4633-a171-983fe4bdf939 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:52.391860 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ca243a92-8a16-4633-a171-983fe4bdf939 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:52.619794 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:52.652309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:52.655767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:52.659279 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ff088f84-d745-4d6b-9b13-01c217543de2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 1.613400 Aug 23 22:26:52.662168 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 147/309] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:51 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:26:52.692823 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ca243a92-8a16-4633-a171-983fe4bdf939 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:52.702571 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ca243a92-8a16-4633-a171-983fe4bdf939 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.386892 Aug 23 22:26:52.703399 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 163/310] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:52 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:52.977925 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-b73efc9a-ba98-40b9-9844-0419addae28d req-db77eca2-7850-4804-880e-0b9527c867bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30f307e-cf90-4c02-ab66-f16d7bc4b427", "tag": "e9f61e27-4256-4ba2-904d-a608368e989b"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:26:52.992147 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-b73efc9a-ba98-40b9-9844-0419addae28d req-db77eca2-7850-4804-880e-0b9527c867bf service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:52.994569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-b73efc9a-ba98-40b9-9844-0419addae28d req-db77eca2-7850-4804-880e-0b9527c867bf service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:53.004999 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-9deb0924-977b-4cd1-81d6-297a214d9a8a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:53.006118 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-b73efc9a-ba98-40b9-9844-0419addae28d req-db77eca2-7850-4804-880e-0b9527c867bf service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:53.007955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9deb0924-977b-4cd1-81d6-297a214d9a8a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:53.025904 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9deb0924-977b-4cd1-81d6-297a214d9a8a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:53.029433 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9deb0924-977b-4cd1-81d6-297a214d9a8a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:53.029931 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9deb0924-977b-4cd1-81d6-297a214d9a8a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:53.032376 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9deb0924-977b-4cd1-81d6-297a214d9a8a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:53.033171 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9deb0924-977b-4cd1-81d6-297a214d9a8a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:53.033636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9deb0924-977b-4cd1-81d6-297a214d9a8a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:53.048000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-b73efc9a-ba98-40b9-9844-0419addae28d req-db77eca2-7850-4804-880e-0b9527c867bf service nova] Creating event network-changed:e9f61e27-4256-4ba2-904d-a608368e989b for instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 on hv-cinder-85032 Aug 23 22:26:53.058001 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-b73efc9a-ba98-40b9-9844-0419addae28d req-db77eca2-7850-4804-880e-0b9527c867bf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087451 Aug 23 22:26:53.060127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 148/311] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:26:53.226024 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9deb0924-977b-4cd1-81d6-297a214d9a8a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:53.243356 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-9deb0924-977b-4cd1-81d6-297a214d9a8a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.245833 Aug 23 22:26:53.244445 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 164/312] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:52 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:53.324321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d2849e85-633a-4237-b028-c29012c7465e tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:53.325987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d2849e85-633a-4237-b028-c29012c7465e tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:53.334067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d2849e85-633a-4237-b028-c29012c7465e tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:53.334553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d2849e85-633a-4237-b028-c29012c7465e tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:53.334980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d2849e85-633a-4237-b028-c29012c7465e tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:53.335678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d2849e85-633a-4237-b028-c29012c7465e tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:53.336131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d2849e85-633a-4237-b028-c29012c7465e tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:53.336546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d2849e85-633a-4237-b028-c29012c7465e tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:53.524446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d2849e85-633a-4237-b028-c29012c7465e tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:53.534814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d2849e85-633a-4237-b028-c29012c7465e tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.219712 Aug 23 22:26:53.535391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 149/313] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:53 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:53.706799 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:53.707411 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:53.718707 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:53.719362 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:53.719893 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:53.720731 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:53.722007 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:53.722633 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:53.736828 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d1066619-e4db-43f1-b004-fc9b5d2bde10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:53.737490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d1066619-e4db-43f1-b004-fc9b5d2bde10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:53.744240 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1066619-e4db-43f1-b004-fc9b5d2bde10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:53.744783 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1066619-e4db-43f1-b004-fc9b5d2bde10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:53.745647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1066619-e4db-43f1-b004-fc9b5d2bde10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:53.746668 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1066619-e4db-43f1-b004-fc9b5d2bde10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:53.747197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1066619-e4db-43f1-b004-fc9b5d2bde10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:53.747999 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1066619-e4db-43f1-b004-fc9b5d2bde10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:53.922122 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:53.931744 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:53.934217 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:53.936015 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e4295e47-c569-4229-927d-5a4c004cbb46 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.233743 Aug 23 22:26:53.937178 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 165/314] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:53 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:26:53.958291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d1066619-e4db-43f1-b004-fc9b5d2bde10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:53.969416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d1066619-e4db-43f1-b004-fc9b5d2bde10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.236116 Aug 23 22:26:53.970418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 150/315] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:53 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:54.266454 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d3dd9c89-9f9a-4ecc-ba24-6fde44fec7e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:54.267298 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d3dd9c89-9f9a-4ecc-ba24-6fde44fec7e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:54.273366 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d3dd9c89-9f9a-4ecc-ba24-6fde44fec7e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:54.273858 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d3dd9c89-9f9a-4ecc-ba24-6fde44fec7e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:54.274289 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d3dd9c89-9f9a-4ecc-ba24-6fde44fec7e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:54.275009 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d3dd9c89-9f9a-4ecc-ba24-6fde44fec7e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:54.276017 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d3dd9c89-9f9a-4ecc-ba24-6fde44fec7e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:54.276514 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d3dd9c89-9f9a-4ecc-ba24-6fde44fec7e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:54.451443 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d3dd9c89-9f9a-4ecc-ba24-6fde44fec7e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:54.455177 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:54.461392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d3dd9c89-9f9a-4ecc-ba24-6fde44fec7e8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.199059 Aug 23 22:26:54.461970 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 166/316] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:54 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:54.560336 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-241a671c-9155-4721-a533-c62bb05ecb05 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:54.562215 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-241a671c-9155-4721-a533-c62bb05ecb05 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:54.569408 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-241a671c-9155-4721-a533-c62bb05ecb05 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:54.570402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-241a671c-9155-4721-a533-c62bb05ecb05 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:54.571999 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-241a671c-9155-4721-a533-c62bb05ecb05 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:54.575629 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-241a671c-9155-4721-a533-c62bb05ecb05 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:54.576733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-241a671c-9155-4721-a533-c62bb05ecb05 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:54.577526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-241a671c-9155-4721-a533-c62bb05ecb05 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:54.781438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-241a671c-9155-4721-a533-c62bb05ecb05 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:54.789685 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-241a671c-9155-4721-a533-c62bb05ecb05 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.235881 Aug 23 22:26:54.790173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 151/317] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:54 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:54.961334 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:54.962125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:54.971862 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:54.972355 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:54.972798 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:54.973572 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:54.973989 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:54.974410 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:54.998641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d1784eec-6c38-4319-aa53-ddaed8705480 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:54.999277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d1784eec-6c38-4319-aa53-ddaed8705480 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:55.007501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1784eec-6c38-4319-aa53-ddaed8705480 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:55.008327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1784eec-6c38-4319-aa53-ddaed8705480 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:55.008771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1784eec-6c38-4319-aa53-ddaed8705480 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:55.011214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1784eec-6c38-4319-aa53-ddaed8705480 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:55.012034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1784eec-6c38-4319-aa53-ddaed8705480 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:55.012854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1784eec-6c38-4319-aa53-ddaed8705480 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:55.128947 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:55.138568 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:55.140091 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:55.141308 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7b91d2a4-4964-45d8-a8f7-ebaca14c472a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.185446 Aug 23 22:26:55.141867 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 167/318] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:54 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:26:55.178370 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d1784eec-6c38-4319-aa53-ddaed8705480 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:55.188860 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d1784eec-6c38-4319-aa53-ddaed8705480 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.196482 Aug 23 22:26:55.189631 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 152/319] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:54 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:55.488114 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-4bf36a4c-241f-47ef-8a83-77491e2cfbd5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:55.490762 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-4bf36a4c-241f-47ef-8a83-77491e2cfbd5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:55.504976 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4bf36a4c-241f-47ef-8a83-77491e2cfbd5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:55.506404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4bf36a4c-241f-47ef-8a83-77491e2cfbd5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:55.507203 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4bf36a4c-241f-47ef-8a83-77491e2cfbd5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:55.508700 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4bf36a4c-241f-47ef-8a83-77491e2cfbd5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:55.510214 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4bf36a4c-241f-47ef-8a83-77491e2cfbd5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:55.510848 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4bf36a4c-241f-47ef-8a83-77491e2cfbd5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:55.813330 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e1bf27ce-49d0-4189-a0df-b6878d29901f tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:55.814089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e1bf27ce-49d0-4189-a0df-b6878d29901f tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:55.822287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1bf27ce-49d0-4189-a0df-b6878d29901f tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:55.823151 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1bf27ce-49d0-4189-a0df-b6878d29901f tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:55.823798 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1bf27ce-49d0-4189-a0df-b6878d29901f tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:55.825173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1bf27ce-49d0-4189-a0df-b6878d29901f tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:55.825951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1bf27ce-49d0-4189-a0df-b6878d29901f tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:55.827497 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1bf27ce-49d0-4189-a0df-b6878d29901f tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:55.887553 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-4bf36a4c-241f-47ef-8a83-77491e2cfbd5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:55.920018 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-4bf36a4c-241f-47ef-8a83-77491e2cfbd5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.438913 Aug 23 22:26:55.924154 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 168/320] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:55 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:56.024647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e1bf27ce-49d0-4189-a0df-b6878d29901f tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:56.037195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e1bf27ce-49d0-4189-a0df-b6878d29901f tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.227891 Aug 23 22:26:56.037941 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 153/321] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:55 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:56.177643 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:56.178544 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:56.189196 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:56.189759 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:56.190247 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:56.191058 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:56.191576 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:56.192091 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:56.215109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-06b3c11a-5a07-4ec0-bdb7-21be229fafa4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:56.216534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-06b3c11a-5a07-4ec0-bdb7-21be229fafa4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:56.226876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06b3c11a-5a07-4ec0-bdb7-21be229fafa4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:56.228417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06b3c11a-5a07-4ec0-bdb7-21be229fafa4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:56.229359 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06b3c11a-5a07-4ec0-bdb7-21be229fafa4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:56.231233 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06b3c11a-5a07-4ec0-bdb7-21be229fafa4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:56.232517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06b3c11a-5a07-4ec0-bdb7-21be229fafa4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:56.233231 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06b3c11a-5a07-4ec0-bdb7-21be229fafa4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:56.467844 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:56.470220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-06b3c11a-5a07-4ec0-bdb7-21be229fafa4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:56.478169 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:56.480296 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:56.481788 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8c3a7753-338b-4f8e-9223-e541056260bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.310117 Aug 23 22:26:56.482356 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 169/322] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:56 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:26:56.485817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-06b3c11a-5a07-4ec0-bdb7-21be229fafa4 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.277366 Aug 23 22:26:56.486833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 154/323] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:56 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:56.954661 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cd9453a1-6775-4141-b898-a77df0fa027f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:56.956171 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-cd9453a1-6775-4141-b898-a77df0fa027f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:56.965216 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cd9453a1-6775-4141-b898-a77df0fa027f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:56.965803 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cd9453a1-6775-4141-b898-a77df0fa027f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:56.966349 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cd9453a1-6775-4141-b898-a77df0fa027f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:56.968551 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cd9453a1-6775-4141-b898-a77df0fa027f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:56.970652 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cd9453a1-6775-4141-b898-a77df0fa027f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:56.971453 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cd9453a1-6775-4141-b898-a77df0fa027f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:57.079991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3a7862af-5de7-4608-96dd-6f2b2d1f0d85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:57.080831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3a7862af-5de7-4608-96dd-6f2b2d1f0d85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:57.111896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a7862af-5de7-4608-96dd-6f2b2d1f0d85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:57.112420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a7862af-5de7-4608-96dd-6f2b2d1f0d85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:57.113184 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a7862af-5de7-4608-96dd-6f2b2d1f0d85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:57.118260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a7862af-5de7-4608-96dd-6f2b2d1f0d85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:57.120212 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a7862af-5de7-4608-96dd-6f2b2d1f0d85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:57.120964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a7862af-5de7-4608-96dd-6f2b2d1f0d85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:57.348033 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-cd9453a1-6775-4141-b898-a77df0fa027f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:57.371767 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-cd9453a1-6775-4141-b898-a77df0fa027f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.430158 Aug 23 22:26:57.372553 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 170/324] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:56 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:57.510038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3a7862af-5de7-4608-96dd-6f2b2d1f0d85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:57.530543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3a7862af-5de7-4608-96dd-6f2b2d1f0d85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.454142 Aug 23 22:26:57.533297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 155/325] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:57 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:57.544115 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2ad5532e-3d6e-41e4-bf39-0c760722340d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:57.545788 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2ad5532e-3d6e-41e4-bf39-0c760722340d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:57.564369 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:57.565846 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:57.581532 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2ad5532e-3d6e-41e4-bf39-0c760722340d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:57.598056 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2ad5532e-3d6e-41e4-bf39-0c760722340d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:57.611306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2ad5532e-3d6e-41e4-bf39-0c760722340d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:57.619574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2ad5532e-3d6e-41e4-bf39-0c760722340d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:57.624630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2ad5532e-3d6e-41e4-bf39-0c760722340d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:57.628880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2ad5532e-3d6e-41e4-bf39-0c760722340d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:57.638464 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:57.643908 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:57.651169 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:57.659440 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:57.662808 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:57.667856 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:58.186949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2ad5532e-3d6e-41e4-bf39-0c760722340d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:58.199104 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:58.218420 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:58.221032 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2ad5532e-3d6e-41e4-bf39-0c760722340d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.685756 Aug 23 22:26:58.222053 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 156/326] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:57 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:58.241311 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:58.245984 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3cf5c9ff-365d-4018-be4b-d14c3202b745 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.732216 Aug 23 22:26:58.265473 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 171/327] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:57 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:26:58.428635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3513ec3a-8c51-413e-807d-10f30547835b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:58.429886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3513ec3a-8c51-413e-807d-10f30547835b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:58.442952 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3513ec3a-8c51-413e-807d-10f30547835b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:58.449899 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3513ec3a-8c51-413e-807d-10f30547835b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:58.450338 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3513ec3a-8c51-413e-807d-10f30547835b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:58.451111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3513ec3a-8c51-413e-807d-10f30547835b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:58.451966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3513ec3a-8c51-413e-807d-10f30547835b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:58.452808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3513ec3a-8c51-413e-807d-10f30547835b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:58.579943 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d2748470-6468-471f-979b-c795a8f1d6a6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:58.580934 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d2748470-6468-471f-979b-c795a8f1d6a6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:58.588989 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d2748470-6468-471f-979b-c795a8f1d6a6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:58.589984 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d2748470-6468-471f-979b-c795a8f1d6a6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:58.590637 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d2748470-6468-471f-979b-c795a8f1d6a6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:58.591728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d2748470-6468-471f-979b-c795a8f1d6a6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:58.592501 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d2748470-6468-471f-979b-c795a8f1d6a6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:58.593405 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d2748470-6468-471f-979b-c795a8f1d6a6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:58.773172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3513ec3a-8c51-413e-807d-10f30547835b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:58.789034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3513ec3a-8c51-413e-807d-10f30547835b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.377870 Aug 23 22:26:58.789766 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 157/328] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:58 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:58.881958 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d2748470-6468-471f-979b-c795a8f1d6a6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:58.896463 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d2748470-6468-471f-979b-c795a8f1d6a6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.320941 Aug 23 22:26:58.897416 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 172/329] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:58 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:26:59.264515 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8643496c-cadb-47e8-a58f-0d51bae32e37 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:59.268543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8643496c-cadb-47e8-a58f-0d51bae32e37 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:59.283151 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:59.285597 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:59.298808 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:59.299710 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8643496c-cadb-47e8-a58f-0d51bae32e37 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:59.300463 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:59.300647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8643496c-cadb-47e8-a58f-0d51bae32e37 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:59.301305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8643496c-cadb-47e8-a58f-0d51bae32e37 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:59.302064 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:59.302523 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8643496c-cadb-47e8-a58f-0d51bae32e37 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:59.303292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8643496c-cadb-47e8-a58f-0d51bae32e37 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:59.304016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8643496c-cadb-47e8-a58f-0d51bae32e37 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:59.304484 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:59.305564 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:59.307404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:59.879904 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8643496c-cadb-47e8-a58f-0d51bae32e37 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:59.910418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8643496c-cadb-47e8-a58f-0d51bae32e37 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.650388 Aug 23 22:26:59.911742 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 158/330] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:59 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:26:59.922008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a7b4a835-6659-41fa-ba67-e489a6e7c1d5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:59.923605 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a7b4a835-6659-41fa-ba67-e489a6e7c1d5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:59.928472 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:59.935853 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a7b4a835-6659-41fa-ba67-e489a6e7c1d5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:59.937179 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a7b4a835-6659-41fa-ba67-e489a6e7c1d5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:59.938165 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a7b4a835-6659-41fa-ba67-e489a6e7c1d5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:59.939204 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:59.940191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a7b4a835-6659-41fa-ba67-e489a6e7c1d5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:59.941281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a7b4a835-6659-41fa-ba67-e489a6e7c1d5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:59.942234 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a7b4a835-6659-41fa-ba67-e489a6e7c1d5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:59.947637 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:26:59.950322 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-9032f3e3-f58e-4657-986d-9ce9565f21d5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.676567 Aug 23 22:26:59.951246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 173/331] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:26:59 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:26:59.962181 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-f9b9eb91-f24d-42b5-858c-bb8cd037ca22 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:26:59.966634 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-f9b9eb91-f24d-42b5-858c-bb8cd037ca22 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:26:59.991622 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f9b9eb91-f24d-42b5-858c-bb8cd037ca22 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:59.992359 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f9b9eb91-f24d-42b5-858c-bb8cd037ca22 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:59.993025 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f9b9eb91-f24d-42b5-858c-bb8cd037ca22 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:26:59.994622 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f9b9eb91-f24d-42b5-858c-bb8cd037ca22 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:26:59.995324 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f9b9eb91-f24d-42b5-858c-bb8cd037ca22 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:26:59.996036 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f9b9eb91-f24d-42b5-858c-bb8cd037ca22 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:00.221300 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a7b4a835-6659-41fa-ba67-e489a6e7c1d5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:00.233695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a7b4a835-6659-41fa-ba67-e489a6e7c1d5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.319516 Aug 23 22:27:00.234575 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 159/332] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:59 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:00.440653 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-f9b9eb91-f24d-42b5-858c-bb8cd037ca22 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:00.449934 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-f9b9eb91-f24d-42b5-858c-bb8cd037ca22 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.497559 Aug 23 22:27:00.450527 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 174/333] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:26:59 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:00.936970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0c6d323f-eb62-4483-a88a-baebf13e1717 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:00.937622 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0c6d323f-eb62-4483-a88a-baebf13e1717 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:00.940069 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:00.946333 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c6d323f-eb62-4483-a88a-baebf13e1717 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:00.947617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c6d323f-eb62-4483-a88a-baebf13e1717 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:00.948066 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c6d323f-eb62-4483-a88a-baebf13e1717 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:00.948924 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c6d323f-eb62-4483-a88a-baebf13e1717 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:00.949503 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c6d323f-eb62-4483-a88a-baebf13e1717 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:00.950000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c6d323f-eb62-4483-a88a-baebf13e1717 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:00.995706 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:00.996844 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:01.008076 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:01.008973 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:01.010480 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:01.011643 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:01.012555 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:01.013222 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:01.133587 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0c6d323f-eb62-4483-a88a-baebf13e1717 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:01.141952 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0c6d323f-eb62-4483-a88a-baebf13e1717 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.208868 Aug 23 22:27:01.142535 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 160/334] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:00 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:01.195506 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:01.204991 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:01.206708 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:01.208070 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-eb1ac285-4127-40e0-a29c-711b1a1da2ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.218588 Aug 23 22:27:01.208482 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 175/335] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:00 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:27:01.257340 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6cf66f5d-17a9-4476-b82c-c73db71875ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:01.257980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6cf66f5d-17a9-4476-b82c-c73db71875ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:01.264250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6cf66f5d-17a9-4476-b82c-c73db71875ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:01.265011 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6cf66f5d-17a9-4476-b82c-c73db71875ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:01.265524 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6cf66f5d-17a9-4476-b82c-c73db71875ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:01.266221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6cf66f5d-17a9-4476-b82c-c73db71875ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:01.266672 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6cf66f5d-17a9-4476-b82c-c73db71875ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:01.267088 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6cf66f5d-17a9-4476-b82c-c73db71875ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:01.412233 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6cf66f5d-17a9-4476-b82c-c73db71875ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:01.422223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6cf66f5d-17a9-4476-b82c-c73db71875ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.168643 Aug 23 22:27:01.422861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 161/336] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:01 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:01.472299 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-92c479e5-e307-4765-bb99-af376a656755 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:01.473014 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-92c479e5-e307-4765-bb99-af376a656755 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:01.482471 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92c479e5-e307-4765-bb99-af376a656755 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:01.482959 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92c479e5-e307-4765-bb99-af376a656755 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:01.483392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92c479e5-e307-4765-bb99-af376a656755 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:01.484090 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92c479e5-e307-4765-bb99-af376a656755 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:01.484535 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92c479e5-e307-4765-bb99-af376a656755 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:01.484949 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-92c479e5-e307-4765-bb99-af376a656755 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:01.654109 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-92c479e5-e307-4765-bb99-af376a656755 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:01.662202 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-92c479e5-e307-4765-bb99-af376a656755 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.194351 Aug 23 22:27:01.662789 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 176/337] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:01 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:02.167035 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f0e3c652-83ae-4584-86f7-c7cfe4745fca tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:02.169216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f0e3c652-83ae-4584-86f7-c7cfe4745fca tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:02.176052 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0e3c652-83ae-4584-86f7-c7cfe4745fca tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:02.176513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0e3c652-83ae-4584-86f7-c7cfe4745fca tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:02.176880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0e3c652-83ae-4584-86f7-c7cfe4745fca tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:02.177836 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0e3c652-83ae-4584-86f7-c7cfe4745fca tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:02.178747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0e3c652-83ae-4584-86f7-c7cfe4745fca tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:02.179335 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0e3c652-83ae-4584-86f7-c7cfe4745fca tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:02.198644 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=100 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:02.236697 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:02.237749 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:02.248202 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:02.249455 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:02.250140 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:02.251004 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:02.251575 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:02.252196 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:02.393485 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f0e3c652-83ae-4584-86f7-c7cfe4745fca tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:02.410258 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f0e3c652-83ae-4584-86f7-c7cfe4745fca tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.247839 Aug 23 22:27:02.425517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 162/338] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:02 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:02.451262 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c7d6f50b-0c4b-4be6-914e-b0e1d7d5e8f8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:02.455908 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c7d6f50b-0c4b-4be6-914e-b0e1d7d5e8f8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:02.479384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7d6f50b-0c4b-4be6-914e-b0e1d7d5e8f8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:02.480201 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7d6f50b-0c4b-4be6-914e-b0e1d7d5e8f8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:02.480955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7d6f50b-0c4b-4be6-914e-b0e1d7d5e8f8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:02.482138 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7d6f50b-0c4b-4be6-914e-b0e1d7d5e8f8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:02.482878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7d6f50b-0c4b-4be6-914e-b0e1d7d5e8f8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:02.483571 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7d6f50b-0c4b-4be6-914e-b0e1d7d5e8f8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:02.626936 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:02.659086 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:02.667196 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:02.682655 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-b66bf21f-9c00-49fa-a1ac-3f8f9ca1bd71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.443707 Aug 23 22:27:02.683642 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 177/339] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:02 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:02.719426 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-65d71be1-6dd9-4d4f-8ec9-57b95d4a53e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:02.720634 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-65d71be1-6dd9-4d4f-8ec9-57b95d4a53e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:02.734235 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65d71be1-6dd9-4d4f-8ec9-57b95d4a53e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:02.735405 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65d71be1-6dd9-4d4f-8ec9-57b95d4a53e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:02.736400 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65d71be1-6dd9-4d4f-8ec9-57b95d4a53e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:02.738253 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65d71be1-6dd9-4d4f-8ec9-57b95d4a53e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:02.739481 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65d71be1-6dd9-4d4f-8ec9-57b95d4a53e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:02.741105 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-65d71be1-6dd9-4d4f-8ec9-57b95d4a53e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:02.997534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c7d6f50b-0c4b-4be6-914e-b0e1d7d5e8f8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:03.024622 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c7d6f50b-0c4b-4be6-914e-b0e1d7d5e8f8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.582213 Aug 23 22:27:03.034476 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 163/340] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:02 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:03.102232 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-65d71be1-6dd9-4d4f-8ec9-57b95d4a53e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:03.156488 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-65d71be1-6dd9-4d4f-8ec9-57b95d4a53e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.452777 Aug 23 22:27:03.157436 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 178/341] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:02 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:03.438925 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e0facbf8-6387-4558-92eb-b7048b9cf991 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:03.439765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e0facbf8-6387-4558-92eb-b7048b9cf991 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:03.462581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0facbf8-6387-4558-92eb-b7048b9cf991 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:03.464791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0facbf8-6387-4558-92eb-b7048b9cf991 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:03.465897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0facbf8-6387-4558-92eb-b7048b9cf991 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:03.476932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0facbf8-6387-4558-92eb-b7048b9cf991 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:03.478209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0facbf8-6387-4558-92eb-b7048b9cf991 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:03.479000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0facbf8-6387-4558-92eb-b7048b9cf991 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:03.709611 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:03.710257 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:03.751483 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:03.751996 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:03.752442 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:03.753198 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:03.753666 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:03.754101 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:03.876100 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e0facbf8-6387-4558-92eb-b7048b9cf991 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:03.887689 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e0facbf8-6387-4558-92eb-b7048b9cf991 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.457690 Aug 23 22:27:03.888640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 164/342] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:03 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:04.023854 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:04.034418 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:04.036460 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:04.038031 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-36e0cb83-04e0-45db-8de1-84d556ac4b50 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.332217 Aug 23 22:27:04.053718 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 179/343] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:03 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:04.063951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e89f1ec5-a0fa-4a3c-b61d-5b3b66de921b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:04.064887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e89f1ec5-a0fa-4a3c-b61d-5b3b66de921b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:04.071495 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e89f1ec5-a0fa-4a3c-b61d-5b3b66de921b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:04.072441 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e89f1ec5-a0fa-4a3c-b61d-5b3b66de921b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:04.073286 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e89f1ec5-a0fa-4a3c-b61d-5b3b66de921b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:04.074468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e89f1ec5-a0fa-4a3c-b61d-5b3b66de921b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:04.075214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e89f1ec5-a0fa-4a3c-b61d-5b3b66de921b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:04.075803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e89f1ec5-a0fa-4a3c-b61d-5b3b66de921b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:04.187709 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-62abac74-ebdf-4602-abb4-b097c6642071 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:04.188607 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-62abac74-ebdf-4602-abb4-b097c6642071 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:04.199245 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-62abac74-ebdf-4602-abb4-b097c6642071 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:04.200528 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-62abac74-ebdf-4602-abb4-b097c6642071 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:04.201185 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-62abac74-ebdf-4602-abb4-b097c6642071 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:04.202229 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-62abac74-ebdf-4602-abb4-b097c6642071 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:04.203186 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-62abac74-ebdf-4602-abb4-b097c6642071 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:04.206082 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-62abac74-ebdf-4602-abb4-b097c6642071 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:04.287155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e89f1ec5-a0fa-4a3c-b61d-5b3b66de921b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:04.304735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e89f1ec5-a0fa-4a3c-b61d-5b3b66de921b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.244925 Aug 23 22:27:04.305360 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 165/344] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:04 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:04.422676 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-62abac74-ebdf-4602-abb4-b097c6642071 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:04.435265 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-62abac74-ebdf-4602-abb4-b097c6642071 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.251431 Aug 23 22:27:04.436785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 180/345] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:04 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:04.920082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f6ff86d7-bb82-4f75-82c5-33c28a3d15b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:04.921375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f6ff86d7-bb82-4f75-82c5-33c28a3d15b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:04.928114 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6ff86d7-bb82-4f75-82c5-33c28a3d15b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:04.928898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6ff86d7-bb82-4f75-82c5-33c28a3d15b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:04.929575 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6ff86d7-bb82-4f75-82c5-33c28a3d15b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:04.930483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6ff86d7-bb82-4f75-82c5-33c28a3d15b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:04.931986 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6ff86d7-bb82-4f75-82c5-33c28a3d15b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:04.932627 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6ff86d7-bb82-4f75-82c5-33c28a3d15b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:05.066722 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:05.073569 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:05.098303 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:05.099602 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:05.100697 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:05.102359 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:05.104285 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:05.110422 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:05.151655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f6ff86d7-bb82-4f75-82c5-33c28a3d15b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:05.170353 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f6ff86d7-bb82-4f75-82c5-33c28a3d15b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.254774 Aug 23 22:27:05.175443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 166/346] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:04 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:05.348129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-310ffee0-01e2-4654-a9ff-dde697e59419 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:05.349273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-310ffee0-01e2-4654-a9ff-dde697e59419 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:05.355311 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:05.359213 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-310ffee0-01e2-4654-a9ff-dde697e59419 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:05.360386 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-310ffee0-01e2-4654-a9ff-dde697e59419 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:05.361264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-310ffee0-01e2-4654-a9ff-dde697e59419 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:05.362505 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-310ffee0-01e2-4654-a9ff-dde697e59419 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:05.363223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-310ffee0-01e2-4654-a9ff-dde697e59419 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:05.364012 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-310ffee0-01e2-4654-a9ff-dde697e59419 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:05.365529 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:05.367228 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:05.368640 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5e3b1bc6-4b49-4bc1-a584-fda88ddbcb0d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.309424 Aug 23 22:27:05.376695 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 181/347] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:05 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:05.466721 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-186cf910-457a-4e1b-bab9-9cee794588f3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:05.468585 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-186cf910-457a-4e1b-bab9-9cee794588f3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:05.485816 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-186cf910-457a-4e1b-bab9-9cee794588f3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:05.491021 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-186cf910-457a-4e1b-bab9-9cee794588f3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:05.491993 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-186cf910-457a-4e1b-bab9-9cee794588f3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:05.493127 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-186cf910-457a-4e1b-bab9-9cee794588f3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:05.494024 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-186cf910-457a-4e1b-bab9-9cee794588f3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:05.496662 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-186cf910-457a-4e1b-bab9-9cee794588f3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:05.633438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-310ffee0-01e2-4654-a9ff-dde697e59419 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:05.660062 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-310ffee0-01e2-4654-a9ff-dde697e59419 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.317146 Aug 23 22:27:05.664572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 167/348] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:05 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:05.831129 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-186cf910-457a-4e1b-bab9-9cee794588f3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:05.847403 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-186cf910-457a-4e1b-bab9-9cee794588f3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.389801 Aug 23 22:27:05.861608 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 182/349] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:05 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:06.209884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fd04c13a-d748-4a5e-b393-97e8ae358604 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:06.211968 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fd04c13a-d748-4a5e-b393-97e8ae358604 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:06.274140 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd04c13a-d748-4a5e-b393-97e8ae358604 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:06.277812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd04c13a-d748-4a5e-b393-97e8ae358604 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:06.296650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd04c13a-d748-4a5e-b393-97e8ae358604 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:06.303359 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd04c13a-d748-4a5e-b393-97e8ae358604 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:06.329352 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd04c13a-d748-4a5e-b393-97e8ae358604 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:06.330618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd04c13a-d748-4a5e-b393-97e8ae358604 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:06.409025 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:06.414230 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:06.439992 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:06.441526 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:06.448626 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:06.449919 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:06.450665 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:06.455141 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:06.519720 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=100 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:06.809637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fd04c13a-d748-4a5e-b393-97e8ae358604 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:06.833475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fd04c13a-d748-4a5e-b393-97e8ae358604 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.633362 Aug 23 22:27:06.838389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 168/350] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:06 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:06.846759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-baf4f15c-3065-49a9-a6ad-fff4e60b094a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:06.854030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-baf4f15c-3065-49a9-a6ad-fff4e60b094a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:06.862187 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:06.867388 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baf4f15c-3065-49a9-a6ad-fff4e60b094a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:06.870007 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baf4f15c-3065-49a9-a6ad-fff4e60b094a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:06.872246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:06.873175 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baf4f15c-3065-49a9-a6ad-fff4e60b094a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:06.874198 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baf4f15c-3065-49a9-a6ad-fff4e60b094a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:06.874682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baf4f15c-3065-49a9-a6ad-fff4e60b094a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:06.875036 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:06.876332 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-6a534ba0-1d9b-4055-89c6-8d7447ffe53c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.480696 Aug 23 22:27:06.877858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baf4f15c-3065-49a9-a6ad-fff4e60b094a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:06.893604 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 183/351] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:06 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:06.899023 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-9afd253e-a499-427a-8351-36d4aee2fece tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:06.900637 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9afd253e-a499-427a-8351-36d4aee2fece tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:06.907763 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9afd253e-a499-427a-8351-36d4aee2fece tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:06.908588 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9afd253e-a499-427a-8351-36d4aee2fece tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:06.909288 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9afd253e-a499-427a-8351-36d4aee2fece tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:06.910239 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9afd253e-a499-427a-8351-36d4aee2fece tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:06.910946 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9afd253e-a499-427a-8351-36d4aee2fece tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:06.911523 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9afd253e-a499-427a-8351-36d4aee2fece tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:07.287906 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9afd253e-a499-427a-8351-36d4aee2fece tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:07.304074 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-9afd253e-a499-427a-8351-36d4aee2fece tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.409246 Aug 23 22:27:07.308491 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 184/352] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:06 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:07.862719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5dfe7c11-fcb1-437f-98bb-c31f577cffa8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:07.864241 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-5dfe7c11-fcb1-437f-98bb-c31f577cffa8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:07.881046 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5dfe7c11-fcb1-437f-98bb-c31f577cffa8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:07.882277 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5dfe7c11-fcb1-437f-98bb-c31f577cffa8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:07.885731 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5dfe7c11-fcb1-437f-98bb-c31f577cffa8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:07.886896 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5dfe7c11-fcb1-437f-98bb-c31f577cffa8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:07.887624 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5dfe7c11-fcb1-437f-98bb-c31f577cffa8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:07.889335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5dfe7c11-fcb1-437f-98bb-c31f577cffa8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:08.047275 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-baf4f15c-3065-49a9-a6ad-fff4e60b094a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:08.076095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-baf4f15c-3065-49a9-a6ad-fff4e60b094a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 1.234978 Aug 23 22:27:08.078460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 169/353] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:06 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:08.097349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:08.099658 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:08.126167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:08.127669 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:08.130825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:08.131954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:08.136514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:08.138939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:08.451802 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5dfe7c11-fcb1-437f-98bb-c31f577cffa8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:08.466701 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5dfe7c11-fcb1-437f-98bb-c31f577cffa8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.608481 Aug 23 22:27:08.478402 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 185/354] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:07 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:08.479737 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-26ab4aa2-7f55-40ba-972d-46ed92b1911d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:08.482746 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-26ab4aa2-7f55-40ba-972d-46ed92b1911d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:08.507096 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26ab4aa2-7f55-40ba-972d-46ed92b1911d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:08.508782 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26ab4aa2-7f55-40ba-972d-46ed92b1911d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:08.510034 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26ab4aa2-7f55-40ba-972d-46ed92b1911d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:08.511320 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26ab4aa2-7f55-40ba-972d-46ed92b1911d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:08.511967 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26ab4aa2-7f55-40ba-972d-46ed92b1911d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:08.512253 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26ab4aa2-7f55-40ba-972d-46ed92b1911d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:09.069249 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-26ab4aa2-7f55-40ba-972d-46ed92b1911d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:09.095973 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-26ab4aa2-7f55-40ba-972d-46ed92b1911d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.625022 Aug 23 22:27:09.106497 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 186/355] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:08 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:09.122248 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-6906f4c1-0ff1-4a52-835e-b11b347496ce tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:09.123324 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-6906f4c1-0ff1-4a52-835e-b11b347496ce tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:09.132036 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:09.137771 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6906f4c1-0ff1-4a52-835e-b11b347496ce tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:09.138736 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6906f4c1-0ff1-4a52-835e-b11b347496ce tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:09.140916 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6906f4c1-0ff1-4a52-835e-b11b347496ce tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:09.141923 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6906f4c1-0ff1-4a52-835e-b11b347496ce tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:09.145134 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6906f4c1-0ff1-4a52-835e-b11b347496ce tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:09.146459 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6906f4c1-0ff1-4a52-835e-b11b347496ce tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:09.280506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:09.289942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:09.291590 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:09.293139 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-95d5295f-defb-43e0-8060-96a8b891c209 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1743 microversion: 2.20 time: 1.211610 Aug 23 22:27:09.309034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 170/356] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:08 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1743 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:09.500542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a95d8f1a-74d9-4ea3-9841-5b12779abd42 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:09.500542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a95d8f1a-74d9-4ea3-9841-5b12779abd42 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:09.515365 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a95d8f1a-74d9-4ea3-9841-5b12779abd42 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:09.517886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a95d8f1a-74d9-4ea3-9841-5b12779abd42 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:09.519094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a95d8f1a-74d9-4ea3-9841-5b12779abd42 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:09.522957 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a95d8f1a-74d9-4ea3-9841-5b12779abd42 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:09.526629 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a95d8f1a-74d9-4ea3-9841-5b12779abd42 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:09.527789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a95d8f1a-74d9-4ea3-9841-5b12779abd42 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:09.703761 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-6906f4c1-0ff1-4a52-835e-b11b347496ce tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:09.719670 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-6906f4c1-0ff1-4a52-835e-b11b347496ce tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.601354 Aug 23 22:27:09.726444 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 187/357] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:09 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:10.046295 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cb1d8184-2119-42ea-bc03-508e4a755ea8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: .version_select at 0x7f902c3be280>, body: {"keypair": {"name": "tempest-keypair-1099048839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjvoJ8agytDipBX7nG+P6rkOk6cSJq7hn45xHkGWNUDZq2S0K3gbHcrwJ8So6D/5LP0dMn7zizGacTXan8nZgeTS5J5R3QzUKZ595jkl4uhQlNjnyQ6K6piLsl9DdJaGw=="}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:10.126578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-cb1d8184-2119-42ea-bc03-508e4a755ea8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for project c0fc1c15f821495e9883814ffc7aed78. Resources: {'key_pairs'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:27:10.141104 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-cb1d8184-2119-42ea-bc03-508e4a755ea8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for user 1db1a9a77be6452991ec4f99af814e7a and project c0fc1c15f821495e9883814ffc7aed78. Resources: {'key_pairs'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:27:10.232553 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-cb1d8184-2119-42ea-bc03-508e4a755ea8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190611 Aug 23 22:27:10.233849 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 188/358] 10.222.0.88 () {60 vars in 1159 bytes} [Tue Aug 23 22:27:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:27:10.256501 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-f5bf531b-ab6e-42ab-9b0e-1e3c85562434 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:10.267539 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-f5bf531b-ab6e-42ab-9b0e-1e3c85562434 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:10.286573 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f5bf531b-ab6e-42ab-9b0e-1e3c85562434 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:10.292858 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f5bf531b-ab6e-42ab-9b0e-1e3c85562434 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:10.293589 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f5bf531b-ab6e-42ab-9b0e-1e3c85562434 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:10.294700 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f5bf531b-ab6e-42ab-9b0e-1e3c85562434 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:10.295888 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f5bf531b-ab6e-42ab-9b0e-1e3c85562434 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:10.296569 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f5bf531b-ab6e-42ab-9b0e-1e3c85562434 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:10.449485 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a95d8f1a-74d9-4ea3-9841-5b12779abd42 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:10.504480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a95d8f1a-74d9-4ea3-9841-5b12779abd42 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 1.009028 Aug 23 22:27:10.533603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 171/359] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:09 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:10.547195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:10.548105 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:10.557792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:10.559589 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:10.560284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:10.561510 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:10.562246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:10.564078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:10.932780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:11.005049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:11.007079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:11.012432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9fd4a07c-8595-42c3-9c17-d73ccad19a06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1743 microversion: 2.20 time: 0.477406 Aug 23 22:27:11.021617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 172/360] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:10 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1743 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:11.046212 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1199f49f-fa7b-42be-88e9-d2b210985938 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:11.047332 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1199f49f-fa7b-42be-88e9-d2b210985938 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:11.059290 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1199f49f-fa7b-42be-88e9-d2b210985938 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:11.060574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1199f49f-fa7b-42be-88e9-d2b210985938 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:11.061519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1199f49f-fa7b-42be-88e9-d2b210985938 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:11.063309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1199f49f-fa7b-42be-88e9-d2b210985938 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:11.065799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1199f49f-fa7b-42be-88e9-d2b210985938 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:11.067244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1199f49f-fa7b-42be-88e9-d2b210985938 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:11.137754 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-f5bf531b-ab6e-42ab-9b0e-1e3c85562434 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:11.151899 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-f5bf531b-ab6e-42ab-9b0e-1e3c85562434 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.913009 Aug 23 22:27:11.154474 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 189/361] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:10 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:11.434046 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1199f49f-fa7b-42be-88e9-d2b210985938 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:11.447511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1199f49f-fa7b-42be-88e9-d2b210985938 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.423225 Aug 23 22:27:11.447511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 173/362] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:11 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:11.551171 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8dd5fbd2-d936-4224-a5f6-fd4f87d0e2d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:11.552303 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-8dd5fbd2-d936-4224-a5f6-fd4f87d0e2d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:11.586403 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8dd5fbd2-d936-4224-a5f6-fd4f87d0e2d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:11.587782 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8dd5fbd2-d936-4224-a5f6-fd4f87d0e2d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:11.592672 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8dd5fbd2-d936-4224-a5f6-fd4f87d0e2d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:11.593664 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8dd5fbd2-d936-4224-a5f6-fd4f87d0e2d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:11.598120 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8dd5fbd2-d936-4224-a5f6-fd4f87d0e2d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:11.600446 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8dd5fbd2-d936-4224-a5f6-fd4f87d0e2d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:11.764919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-14be15d7-1b7b-46eb-802e-78c28278ee15 req-22de99d1-d9d3-4fa8-9cff-826cc49737a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b697da-19f2-459e-a57e-e386523e4bcf", "name": "network-vif-plugged", "status": "completed", "tag": "5867c0e1-ac00-4c87-bd75-9ca953635248"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:11.797388 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-14be15d7-1b7b-46eb-802e-78c28278ee15 req-22de99d1-d9d3-4fa8-9cff-826cc49737a4 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:11.801444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-14be15d7-1b7b-46eb-802e-78c28278ee15 req-22de99d1-d9d3-4fa8-9cff-826cc49737a4 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:11.804395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-14be15d7-1b7b-46eb-802e-78c28278ee15 req-22de99d1-d9d3-4fa8-9cff-826cc49737a4 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:11.859321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-14be15d7-1b7b-46eb-802e-78c28278ee15 req-22de99d1-d9d3-4fa8-9cff-826cc49737a4 service nova] Creating event network-vif-plugged:5867c0e1-ac00-4c87-bd75-9ca953635248 for instance 80b697da-19f2-459e-a57e-e386523e4bcf on hv-cinder-85032 Aug 23 22:27:11.873762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-14be15d7-1b7b-46eb-802e-78c28278ee15 req-22de99d1-d9d3-4fa8-9cff-826cc49737a4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113858 Aug 23 22:27:11.875039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 174/363] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:27:11.958227 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8dd5fbd2-d936-4224-a5f6-fd4f87d0e2d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:11.972609 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8dd5fbd2-d936-4224-a5f6-fd4f87d0e2d0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.426584 Aug 23 22:27:11.976513 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 190/364] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:11 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:12.052591 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:12.054851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:12.068158 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:12.069641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:12.070315 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:12.071993 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:12.073425 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:12.074092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:12.210683 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-c5e4df66-cff7-4319-bcd4-51b7ff9765d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:12.228041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-c5e4df66-cff7-4319-bcd4-51b7ff9765d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:12.237262 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c5e4df66-cff7-4319-bcd4-51b7ff9765d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:12.240932 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c5e4df66-cff7-4319-bcd4-51b7ff9765d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:12.240932 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c5e4df66-cff7-4319-bcd4-51b7ff9765d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:12.240932 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c5e4df66-cff7-4319-bcd4-51b7ff9765d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:12.240932 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c5e4df66-cff7-4319-bcd4-51b7ff9765d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:12.242582 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c5e4df66-cff7-4319-bcd4-51b7ff9765d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:12.305517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:12.326445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:12.329074 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:12.330575 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d9ca71f7-6a87-438a-b7d1-b4dd8ef0f90c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1738 microversion: 2.20 time: 0.286459 Aug 23 22:27:12.331594 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 175/365] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:12 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:27:12.500286 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a6b5db84-57dd-4115-9df2-4aa690360cd3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:12.501429 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a6b5db84-57dd-4115-9df2-4aa690360cd3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:12.515277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a6b5db84-57dd-4115-9df2-4aa690360cd3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:12.516228 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a6b5db84-57dd-4115-9df2-4aa690360cd3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:12.517401 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a6b5db84-57dd-4115-9df2-4aa690360cd3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:12.518659 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a6b5db84-57dd-4115-9df2-4aa690360cd3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:12.519577 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a6b5db84-57dd-4115-9df2-4aa690360cd3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:12.520530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a6b5db84-57dd-4115-9df2-4aa690360cd3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:12.550133 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c5e4df66-cff7-4319-bcd4-51b7ff9765d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:12.578429 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-c5e4df66-cff7-4319-bcd4-51b7ff9765d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.377594 Aug 23 22:27:12.579902 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 191/366] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:12 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:12.847133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a6b5db84-57dd-4115-9df2-4aa690360cd3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:12.897852 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a6b5db84-57dd-4115-9df2-4aa690360cd3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.406290 Aug 23 22:27:12.900867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 176/367] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:12 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:13.014495 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-fc0fda81-117b-4f00-8184-544e46a90cf5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:13.016498 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-fc0fda81-117b-4f00-8184-544e46a90cf5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:13.043544 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc0fda81-117b-4f00-8184-544e46a90cf5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:13.044993 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc0fda81-117b-4f00-8184-544e46a90cf5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:13.046242 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc0fda81-117b-4f00-8184-544e46a90cf5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:13.049165 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc0fda81-117b-4f00-8184-544e46a90cf5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:13.051140 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc0fda81-117b-4f00-8184-544e46a90cf5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:13.051598 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fc0fda81-117b-4f00-8184-544e46a90cf5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:13.370571 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:13.373004 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:13.385624 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:13.386606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:13.387281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:13.388220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:13.388943 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:13.389628 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:13.705278 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:13.718576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:13.720478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:13.721984 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7b7e542a-e7ae-47ef-8ee2-39d7534686ef tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1738 microversion: 2.20 time: 0.365588 Aug 23 22:27:13.738192 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 177/368] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:13 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1738 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:13.749160 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-820212a4-8e0d-4db9-b57e-13b06cc9851d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:13.750061 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-820212a4-8e0d-4db9-b57e-13b06cc9851d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:13.757355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-820212a4-8e0d-4db9-b57e-13b06cc9851d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:13.758578 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-820212a4-8e0d-4db9-b57e-13b06cc9851d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:13.760209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-820212a4-8e0d-4db9-b57e-13b06cc9851d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:13.761224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-820212a4-8e0d-4db9-b57e-13b06cc9851d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:13.769992 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-820212a4-8e0d-4db9-b57e-13b06cc9851d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:13.770866 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-820212a4-8e0d-4db9-b57e-13b06cc9851d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:13.771394 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-fc0fda81-117b-4f00-8184-544e46a90cf5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:13.822509 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-fc0fda81-117b-4f00-8184-544e46a90cf5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1509 microversion: 2.1 time: 0.816612 Aug 23 22:27:13.824421 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 192/369] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:12 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1509 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:13.939512 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a2e28b49-afe0-4fe4-b62a-e272fb708fd7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:13.940135 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a2e28b49-afe0-4fe4-b62a-e272fb708fd7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:13.950772 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a2e28b49-afe0-4fe4-b62a-e272fb708fd7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:13.951278 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a2e28b49-afe0-4fe4-b62a-e272fb708fd7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:13.951713 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a2e28b49-afe0-4fe4-b62a-e272fb708fd7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:13.956874 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a2e28b49-afe0-4fe4-b62a-e272fb708fd7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:13.959790 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a2e28b49-afe0-4fe4-b62a-e272fb708fd7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:13.960257 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a2e28b49-afe0-4fe4-b62a-e272fb708fd7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:14.045384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-820212a4-8e0d-4db9-b57e-13b06cc9851d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:14.063242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-820212a4-8e0d-4db9-b57e-13b06cc9851d tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.323353 Aug 23 22:27:14.080703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 178/370] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:13 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:14.391315 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a2e28b49-afe0-4fe4-b62a-e272fb708fd7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:14.403448 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a2e28b49-afe0-4fe4-b62a-e272fb708fd7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.468138 Aug 23 22:27:14.404923 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 193/371] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:13 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:14.756273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:14.757242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:14.802493 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:14.808849 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:14.809797 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:14.811088 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:14.811800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:14.812613 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:14.839917 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1197542339", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c01e5e5-25ba-44de-af70-328d6d292257"}], "security_groups": [{"name": "tempest-securitygroup--531668691"}], "key_name": "tempest-keypair-1099048839", "user_data": "}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:14.870988 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=100 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:15.715171 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:15.731241 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:15.734123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:15.736631 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6acc01ac-43e0-4181-8990-6e21905dc2d0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1738 microversion: 2.20 time: 0.987119 Aug 23 22:27:15.745860 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 179/372] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:14 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1738 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:15.770880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-dceb6e3e-17b3-43bb-84d4-8481209aeaa3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:15.772753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-dceb6e3e-17b3-43bb-84d4-8481209aeaa3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:15.785701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dceb6e3e-17b3-43bb-84d4-8481209aeaa3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:15.787036 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dceb6e3e-17b3-43bb-84d4-8481209aeaa3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:15.788253 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dceb6e3e-17b3-43bb-84d4-8481209aeaa3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:15.790079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dceb6e3e-17b3-43bb-84d4-8481209aeaa3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:15.791308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dceb6e3e-17b3-43bb-84d4-8481209aeaa3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:15.792734 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dceb6e3e-17b3-43bb-84d4-8481209aeaa3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:16.034144 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-dceb6e3e-17b3-43bb-84d4-8481209aeaa3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:16.045572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-dceb6e3e-17b3-43bb-84d4-8481209aeaa3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1515 microversion: 2.1 time: 0.297449 Aug 23 22:27:16.046318 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 180/373] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:15 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1515 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:16.054355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-06ca587e-535e-436f-a824-e38ac5f288e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:16.055375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-06ca587e-535e-436f-a824-e38ac5f288e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:16.063707 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06ca587e-535e-436f-a824-e38ac5f288e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:16.064545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06ca587e-535e-436f-a824-e38ac5f288e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:16.065301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06ca587e-535e-436f-a824-e38ac5f288e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:16.066304 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06ca587e-535e-436f-a824-e38ac5f288e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:16.067193 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06ca587e-535e-436f-a824-e38ac5f288e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:16.067980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-06ca587e-535e-436f-a824-e38ac5f288e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:16.457411 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-06ca587e-535e-436f-a824-e38ac5f288e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:16.469010 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-06ca587e-535e-436f-a824-e38ac5f288e0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.421484 Aug 23 22:27:16.469954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 181/374] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:16 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:16.511223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5b209669-8df8-4e3e-b9a2-a7714cc9ea9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:16.516213 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5b209669-8df8-4e3e-b9a2-a7714cc9ea9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:16.571013 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b209669-8df8-4e3e-b9a2-a7714cc9ea9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:16.577629 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b209669-8df8-4e3e-b9a2-a7714cc9ea9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:16.579679 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b209669-8df8-4e3e-b9a2-a7714cc9ea9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:16.587747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b209669-8df8-4e3e-b9a2-a7714cc9ea9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:16.591421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b209669-8df8-4e3e-b9a2-a7714cc9ea9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:16.593911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b209669-8df8-4e3e-b9a2-a7714cc9ea9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:17.073306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5b209669-8df8-4e3e-b9a2-a7714cc9ea9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:17.112365 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5b209669-8df8-4e3e-b9a2-a7714cc9ea9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1723 microversion: 2.1 time: 0.597403 Aug 23 22:27:17.113214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 182/375] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:16 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1723 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:17.136608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:17.137483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:17.162619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:17.163107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:17.163534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:17.164230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:17.178113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:17.178789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:17.710096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:17.757329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:17.765776 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:17.784337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c102506a-588b-40fd-9526-f3c45795f995 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1738 microversion: 2.20 time: 0.661566 Aug 23 22:27:17.789676 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 183/376] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:17 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1738 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:17.827476 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5326ddba-dfab-4ab2-bc4a-fd0c79f249d4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:17.830999 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5326ddba-dfab-4ab2-bc4a-fd0c79f249d4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:17.872891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5326ddba-dfab-4ab2-bc4a-fd0c79f249d4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:17.874445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5326ddba-dfab-4ab2-bc4a-fd0c79f249d4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:17.875547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5326ddba-dfab-4ab2-bc4a-fd0c79f249d4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:17.877244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5326ddba-dfab-4ab2-bc4a-fd0c79f249d4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:17.881451 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5326ddba-dfab-4ab2-bc4a-fd0c79f249d4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:17.884336 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5326ddba-dfab-4ab2-bc4a-fd0c79f249d4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:18.264026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5326ddba-dfab-4ab2-bc4a-fd0c79f249d4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:18.273771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5326ddba-dfab-4ab2-bc4a-fd0c79f249d4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.480487 Aug 23 22:27:18.275696 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 184/377] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:17 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:18.282013 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-55c7c514-5a5c-4b4e-850f-247d19c9bd75 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'create', calling method: .version_select at 0x7f902e991280>, body: {"keypair": {"name": "tempest-keypair-1919205478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwVFAqh8JqeCqfFR3sjdIphl3eClFzkDGCCkU0oneKsGEIBE+FfvbVRBZ7DO6ZS4eR1eKyFm6IOTdMWrwjhU1giUFI94RzWunXtnxTWSsF6EMNpf+9qI9NR7EAlg/Y1Rg=="}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:18.303747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-55c7c514-5a5c-4b4e-850f-247d19c9bd75 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Getting quotas for project 1dfc84dc05d542d987194096f3b7e51a. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:27:18.309204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-55c7c514-5a5c-4b4e-850f-247d19c9bd75 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Getting quotas for user 78b05a538ce0466ea8b3e27a0a6fc162 and project 1dfc84dc05d542d987194096f3b7e51a. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:27:18.343632 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-55c7c514-5a5c-4b4e-850f-247d19c9bd75 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066628 Aug 23 22:27:18.347284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 185/378] 10.222.0.88 () {60 vars in 1159 bytes} [Tue Aug 23 22:27:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:27:18.361038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2c625c5f-743d-4f79-94f3-69b92732e3b7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:18.362606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2c625c5f-743d-4f79-94f3-69b92732e3b7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:18.379723 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2c625c5f-743d-4f79-94f3-69b92732e3b7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:18.379971 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2c625c5f-743d-4f79-94f3-69b92732e3b7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:18.381603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2c625c5f-743d-4f79-94f3-69b92732e3b7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:18.384824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2c625c5f-743d-4f79-94f3-69b92732e3b7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:18.387235 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2c625c5f-743d-4f79-94f3-69b92732e3b7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:18.388039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2c625c5f-743d-4f79-94f3-69b92732e3b7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:18.627871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2c625c5f-743d-4f79-94f3-69b92732e3b7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:18.647176 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2c625c5f-743d-4f79-94f3-69b92732e3b7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1700 microversion: 2.1 time: 0.296374 Aug 23 22:27:18.649292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 186/379] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:18 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1700 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:18.677960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3eeb950b-5d10-4af3-bff6-30a494862dc6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:18.692308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3eeb950b-5d10-4af3-bff6-30a494862dc6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:18.693715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3eeb950b-5d10-4af3-bff6-30a494862dc6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:18.697800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3eeb950b-5d10-4af3-bff6-30a494862dc6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:18.855533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3eeb950b-5d10-4af3-bff6-30a494862dc6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Going to try to start instance {{(pid=120856) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 22:27:18.943813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3eeb950b-5d10-4af3-bff6-30a494862dc6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/action" status: 202 len: 0 microversion: 2.1 time: 0.269264 Aug 23 22:27:18.951855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 187/380] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:27:18 2022] POST /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:27:18.967597 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:18.969818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:18.980865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:18.981391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:18.981848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:18.982540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:18.982996 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:18.983418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:19.608277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:19.622163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:19.622163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:19.622513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c1fd3e6e-876d-4e32-af05-08c74e4e4c36 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1738 microversion: 2.20 time: 0.664067 Aug 23 22:27:19.623323 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 188/381] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:18 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1738 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:19.628359 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1c15f613-8b2d-4bdd-98f3-6c6ba1008100 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:19.629005 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1c15f613-8b2d-4bdd-98f3-6c6ba1008100 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:19.637203 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c15f613-8b2d-4bdd-98f3-6c6ba1008100 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:19.637920 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c15f613-8b2d-4bdd-98f3-6c6ba1008100 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:19.638376 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c15f613-8b2d-4bdd-98f3-6c6ba1008100 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:19.639296 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c15f613-8b2d-4bdd-98f3-6c6ba1008100 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:19.640162 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c15f613-8b2d-4bdd-98f3-6c6ba1008100 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:19.641477 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c15f613-8b2d-4bdd-98f3-6c6ba1008100 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:19.860706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1c15f613-8b2d-4bdd-98f3-6c6ba1008100 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:19.871376 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1c15f613-8b2d-4bdd-98f3-6c6ba1008100 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1709 microversion: 2.1 time: 0.246870 Aug 23 22:27:19.878106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 189/382] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:19 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1709 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:19.885180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-73114ea9-1967-4acf-b14f-2fa237999601 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:19.886001 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-73114ea9-1967-4acf-b14f-2fa237999601 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:19.893547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73114ea9-1967-4acf-b14f-2fa237999601 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:19.894116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73114ea9-1967-4acf-b14f-2fa237999601 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:19.894530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73114ea9-1967-4acf-b14f-2fa237999601 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:19.895257 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73114ea9-1967-4acf-b14f-2fa237999601 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:19.895715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73114ea9-1967-4acf-b14f-2fa237999601 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:19.896124 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73114ea9-1967-4acf-b14f-2fa237999601 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:20.085048 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-73114ea9-1967-4acf-b14f-2fa237999601 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:20.095442 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-73114ea9-1967-4acf-b14f-2fa237999601 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.216032 Aug 23 22:27:20.112208 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 190/383] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:19 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:20.183232 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=4 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:20.659309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:20.661501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:20.686443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:20.686443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:20.687662 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:20.690434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:20.692067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:20.693436 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:21.296748 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:21.334200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:21.336288 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:21.342838 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-dc1ded7c-0382-46b0-abe5-2da9a0a3a31a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1738 microversion: 2.20 time: 0.697796 Aug 23 22:27:21.346146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 191/384] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:20 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1738 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:27:21.363540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f5bd9bbd-667d-4c77-b6b3-642307f42f09 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:21.364588 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f5bd9bbd-667d-4c77-b6b3-642307f42f09 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:21.392621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f5bd9bbd-667d-4c77-b6b3-642307f42f09 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:21.393652 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f5bd9bbd-667d-4c77-b6b3-642307f42f09 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:21.395703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f5bd9bbd-667d-4c77-b6b3-642307f42f09 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:21.398145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f5bd9bbd-667d-4c77-b6b3-642307f42f09 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:21.401017 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f5bd9bbd-667d-4c77-b6b3-642307f42f09 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:21.402798 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f5bd9bbd-667d-4c77-b6b3-642307f42f09 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:22.057900 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f5bd9bbd-667d-4c77-b6b3-642307f42f09 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:22.084782 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f5bd9bbd-667d-4c77-b6b3-642307f42f09 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1709 microversion: 2.1 time: 0.734385 Aug 23 22:27:22.085407 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 192/385] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:21 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1709 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:22.107012 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0a7201cf-3945-430d-872b-fb3c33ed9fec tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:22.108098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0a7201cf-3945-430d-872b-fb3c33ed9fec tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:22.144401 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a7201cf-3945-430d-872b-fb3c33ed9fec tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:22.146334 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a7201cf-3945-430d-872b-fb3c33ed9fec tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:22.146805 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a7201cf-3945-430d-872b-fb3c33ed9fec tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:22.150789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a7201cf-3945-430d-872b-fb3c33ed9fec tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:22.152340 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a7201cf-3945-430d-872b-fb3c33ed9fec tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:22.153438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0a7201cf-3945-430d-872b-fb3c33ed9fec tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:22.530756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0a7201cf-3945-430d-872b-fb3c33ed9fec tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:22.553262 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0a7201cf-3945-430d-872b-fb3c33ed9fec tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.454405 Aug 23 22:27:22.570123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 193/386] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:22 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:22.580177 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1144636910", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d954100-70c0-4f0f-a697-9d74a7a12bf8"}], "security_groups": [{"name": "tempest-securitygroup--2059120855"}], "key_name": "tempest-keypair-1919205478", "user_data": "}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:24.397360 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=56 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:24.885410 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:28.318751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:28.523603 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.network.neutron [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] validate_networks() for [('4c01e5e5-25ba-44de-af70-328d6d292257', None, None, None, None, None)] {{(pid=120855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:27:28.658256 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] validate_networks() for [('6d954100-70c0-4f0f-a697-9d74a7a12bf8', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:27:29.390742 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Flavor limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:27:29.391533 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Image limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:27:29.392845 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Flavor pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:27:29.394198 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Image pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:27:29.395195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:27:29.439108 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:29.440398 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:29.441724 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:29.443741 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:29.444926 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:29.447178 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:29.496358 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for project c0fc1c15f821495e9883814ffc7aed78. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:27:29.506553 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for user 1db1a9a77be6452991ec4f99af814e7a and project c0fc1c15f821495e9883814ffc7aed78. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:27:29.538817 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Going to run 1 instances... {{(pid=120855) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:27:29.545797 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:27:29.683759 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-bbac8381-735d-41b1-b49e-f9625a4d9681 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 14.850731 Aug 23 22:27:29.688675 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 194/387] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:27:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 14857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:27:29.709456 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:29.710644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:29.728435 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:29.729368 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:29.730704 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:29.732252 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:29.733037 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:29.733759 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:29.850880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:27:29.851681 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:27:29.853772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:27:29.855497 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:27:29.857987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:27:29.897509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:29.898959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:29.899175 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:29.900418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:29.901277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:29.902037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:29.956091 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Getting quotas for project 1dfc84dc05d542d987194096f3b7e51a. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:27:29.965570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Getting quotas for user 78b05a538ce0466ea8b3e27a0a6fc162 and project 1dfc84dc05d542d987194096f3b7e51a. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:27:29.997343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:27:30.003795 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:27:30.127296 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:30.147878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2a6f7e5c-e7c3-4988-96ab-44b98075bdda tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 7.575291 Aug 23 22:27:30.161533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 194/388] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:27:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 7590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:27:30.171961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bd118010-0293-4dd3-85b2-d0a62e864b12 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:30.173716 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bd118010-0293-4dd3-85b2-d0a62e864b12 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:30.189402 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:30.215517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd118010-0293-4dd3-85b2-d0a62e864b12 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:30.221739 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd118010-0293-4dd3-85b2-d0a62e864b12 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:30.224749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd118010-0293-4dd3-85b2-d0a62e864b12 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:30.227641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd118010-0293-4dd3-85b2-d0a62e864b12 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:30.229507 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:30.231099 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd118010-0293-4dd3-85b2-d0a62e864b12 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:30.233709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd118010-0293-4dd3-85b2-d0a62e864b12 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:30.243524 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5f4581a6-3cfd-4e8c-8375-062ec991ec53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1738 microversion: 2.20 time: 0.541738 Aug 23 22:27:30.268803 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 195/389] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:29 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1738 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:30.332991 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-e9563a95-38c0-428d-a867-8963b41d8750 req-4409222a-a235-4e03-9b3e-3c46e20220bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30f307e-cf90-4c02-ab66-f16d7bc4b427", "name": "network-vif-plugged", "status": "completed", "tag": "e9f61e27-4256-4ba2-904d-a608368e989b"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:30.409912 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-e9563a95-38c0-428d-a867-8963b41d8750 req-4409222a-a235-4e03-9b3e-3c46e20220bb service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:30.411350 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-e9563a95-38c0-428d-a867-8963b41d8750 req-4409222a-a235-4e03-9b3e-3c46e20220bb service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:30.411590 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-e9563a95-38c0-428d-a867-8963b41d8750 req-4409222a-a235-4e03-9b3e-3c46e20220bb service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:30.506345 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-e9563a95-38c0-428d-a867-8963b41d8750 req-4409222a-a235-4e03-9b3e-3c46e20220bb service nova] Creating event network-vif-plugged:e9f61e27-4256-4ba2-904d-a608368e989b for instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 on hv-cinder-85032 Aug 23 22:27:30.532747 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-e9563a95-38c0-428d-a867-8963b41d8750 req-4409222a-a235-4e03-9b3e-3c46e20220bb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232306 Aug 23 22:27:30.541599 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 196/390] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:27:30.566066 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-4c002743-e09a-4cf8-95fc-ff036eaf3956 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:30.567355 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-4c002743-e09a-4cf8-95fc-ff036eaf3956 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:30.606545 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c002743-e09a-4cf8-95fc-ff036eaf3956 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:30.607451 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c002743-e09a-4cf8-95fc-ff036eaf3956 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:30.608250 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c002743-e09a-4cf8-95fc-ff036eaf3956 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:30.620208 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c002743-e09a-4cf8-95fc-ff036eaf3956 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:30.632796 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c002743-e09a-4cf8-95fc-ff036eaf3956 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:30.634263 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c002743-e09a-4cf8-95fc-ff036eaf3956 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:30.918557 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-bd118010-0293-4dd3-85b2-d0a62e864b12 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:30.956706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bd118010-0293-4dd3-85b2-d0a62e864b12 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1713 microversion: 2.1 time: 0.786163 Aug 23 22:27:30.958272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 195/391] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:30 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1713 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:30.965109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b4d0f0f9-fa9c-4ea3-abbf-c0bca5932a56 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:30.975275 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b4d0f0f9-fa9c-4ea3-abbf-c0bca5932a56 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:31.011765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:31.014826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4d0f0f9-fa9c-4ea3-abbf-c0bca5932a56 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:31.016954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4d0f0f9-fa9c-4ea3-abbf-c0bca5932a56 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:31.017688 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4d0f0f9-fa9c-4ea3-abbf-c0bca5932a56 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:31.021700 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4d0f0f9-fa9c-4ea3-abbf-c0bca5932a56 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:31.024642 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4d0f0f9-fa9c-4ea3-abbf-c0bca5932a56 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:31.026006 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4d0f0f9-fa9c-4ea3-abbf-c0bca5932a56 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:31.129666 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-4c002743-e09a-4cf8-95fc-ff036eaf3956 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:31.141239 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-4c002743-e09a-4cf8-95fc-ff036eaf3956 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.596800 Aug 23 22:27:31.142276 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 197/392] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:30 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:31.179408 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-0edd85f3-8cd9-4bad-8999-64fb92f0896f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:31.184241 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-0edd85f3-8cd9-4bad-8999-64fb92f0896f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:31.345627 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-0edd85f3-8cd9-4bad-8999-64fb92f0896f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:31.356796 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-0edd85f3-8cd9-4bad-8999-64fb92f0896f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1246 microversion: 2.1 time: 0.213135 Aug 23 22:27:31.359708 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 198/393] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:31 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1246 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:31.388037 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:31.393969 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:31.425182 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:31.431057 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:31.431922 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:31.432713 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:31.442057 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:31.442580 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:31.564973 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b4d0f0f9-fa9c-4ea3-abbf-c0bca5932a56 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:31.578940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:31.654316 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b4d0f0f9-fa9c-4ea3-abbf-c0bca5932a56 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1246 microversion: 2.1 time: 0.678498 Aug 23 22:27:31.677436 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 196/394] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:30 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1246 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:31.903625 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:31.931440 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:31.934902 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:31.940876 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-732f3319-4c18-4af6-b88b-db2b0a217b78 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1738 microversion: 2.20 time: 0.579961 Aug 23 22:27:31.962935 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 199/395] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:31 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1738 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:32.197240 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-799bed6e-60da-413d-a7f4-b7bc2cc85ec6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:32.198367 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-799bed6e-60da-413d-a7f4-b7bc2cc85ec6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:32.217944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-799bed6e-60da-413d-a7f4-b7bc2cc85ec6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:32.219356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-799bed6e-60da-413d-a7f4-b7bc2cc85ec6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:32.220235 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-799bed6e-60da-413d-a7f4-b7bc2cc85ec6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:32.222051 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-799bed6e-60da-413d-a7f4-b7bc2cc85ec6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:32.223093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-799bed6e-60da-413d-a7f4-b7bc2cc85ec6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:32.223942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-799bed6e-60da-413d-a7f4-b7bc2cc85ec6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:32.408132 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5c2fa03a-2d5e-433a-a445-207675774149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:32.409822 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-5c2fa03a-2d5e-433a-a445-207675774149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:32.435523 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c2fa03a-2d5e-433a-a445-207675774149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:32.440963 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c2fa03a-2d5e-433a-a445-207675774149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:32.442043 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c2fa03a-2d5e-433a-a445-207675774149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:32.443908 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c2fa03a-2d5e-433a-a445-207675774149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:32.445045 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c2fa03a-2d5e-433a-a445-207675774149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:32.446164 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c2fa03a-2d5e-433a-a445-207675774149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:32.605851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-799bed6e-60da-413d-a7f4-b7bc2cc85ec6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:32.662069 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5c2fa03a-2d5e-433a-a445-207675774149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:32.669868 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-799bed6e-60da-413d-a7f4-b7bc2cc85ec6 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1359 microversion: 2.1 time: 0.468932 Aug 23 22:27:32.671053 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 197/396] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:32 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1359 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:32.719984 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5c2fa03a-2d5e-433a-a445-207675774149 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1250 microversion: 2.1 time: 0.318611 Aug 23 22:27:32.724303 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 200/397] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:32 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1250 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:32.725094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9baba7f0-2948-4773-aab1-ce3a45f53160 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:32.726355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9baba7f0-2948-4773-aab1-ce3a45f53160 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:32.745031 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baba7f0-2948-4773-aab1-ce3a45f53160 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:32.745419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baba7f0-2948-4773-aab1-ce3a45f53160 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:32.760157 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baba7f0-2948-4773-aab1-ce3a45f53160 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:32.762428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baba7f0-2948-4773-aab1-ce3a45f53160 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:32.764223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baba7f0-2948-4773-aab1-ce3a45f53160 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:32.765384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baba7f0-2948-4773-aab1-ce3a45f53160 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:32.904108 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9baba7f0-2948-4773-aab1-ce3a45f53160 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:32.918092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9baba7f0-2948-4773-aab1-ce3a45f53160 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1294 microversion: 2.1 time: 0.219854 Aug 23 22:27:32.919289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 198/398] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:32 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1294 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:32.983796 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:32.984918 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:32.996749 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:32.997701 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:32.998494 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:32.999604 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:33.000548 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:33.001577 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:33.184196 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:33.197621 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:33.200335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:33.202337 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-84ff55b7-dfcc-44be-9bbd-e85342e09821 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1738 microversion: 2.20 time: 0.226730 Aug 23 22:27:33.203271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 201/399] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:32 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:27:33.705440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-621d704c-888f-451b-9ac1-2128a95dfdfb tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:33.707905 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-621d704c-888f-451b-9ac1-2128a95dfdfb tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:33.722092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-621d704c-888f-451b-9ac1-2128a95dfdfb tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:33.723308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-621d704c-888f-451b-9ac1-2128a95dfdfb tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:33.723722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-621d704c-888f-451b-9ac1-2128a95dfdfb tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:33.725310 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-621d704c-888f-451b-9ac1-2128a95dfdfb tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:33.726371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-621d704c-888f-451b-9ac1-2128a95dfdfb tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:33.727889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-621d704c-888f-451b-9ac1-2128a95dfdfb tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:33.752018 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-58dde866-3e40-4c4c-bf78-1e6fa4fa9ba6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:33.753541 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-58dde866-3e40-4c4c-bf78-1e6fa4fa9ba6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:33.768548 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-58dde866-3e40-4c4c-bf78-1e6fa4fa9ba6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:33.770185 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-58dde866-3e40-4c4c-bf78-1e6fa4fa9ba6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:33.771159 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-58dde866-3e40-4c4c-bf78-1e6fa4fa9ba6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:33.772584 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-58dde866-3e40-4c4c-bf78-1e6fa4fa9ba6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:33.773608 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-58dde866-3e40-4c4c-bf78-1e6fa4fa9ba6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:33.775305 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-58dde866-3e40-4c4c-bf78-1e6fa4fa9ba6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:33.931979 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-58dde866-3e40-4c4c-bf78-1e6fa4fa9ba6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:33.941295 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-58dde866-3e40-4c4c-bf78-1e6fa4fa9ba6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1298 microversion: 2.1 time: 0.196482 Aug 23 22:27:33.942516 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 202/400] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:33 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:33.969289 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3406dda3-be85-4ec6-ae77-03af04ada4e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:33.970338 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3406dda3-be85-4ec6-ae77-03af04ada4e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:33.978578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3406dda3-be85-4ec6-ae77-03af04ada4e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:33.979395 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3406dda3-be85-4ec6-ae77-03af04ada4e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:33.979865 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3406dda3-be85-4ec6-ae77-03af04ada4e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:33.980670 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3406dda3-be85-4ec6-ae77-03af04ada4e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:33.981446 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3406dda3-be85-4ec6-ae77-03af04ada4e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:33.982046 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3406dda3-be85-4ec6-ae77-03af04ada4e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:34.034749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-621d704c-888f-451b-9ac1-2128a95dfdfb tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:34.058676 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-621d704c-888f-451b-9ac1-2128a95dfdfb tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1549 microversion: 2.1 time: 0.360286 Aug 23 22:27:34.081568 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 199/401] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:33 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1549 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:34.099778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-476b54eb-b08a-4c8c-a762-e4fe845400e3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:34.100888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-476b54eb-b08a-4c8c-a762-e4fe845400e3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:34.112752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-476b54eb-b08a-4c8c-a762-e4fe845400e3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:34.114047 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-476b54eb-b08a-4c8c-a762-e4fe845400e3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:34.115119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-476b54eb-b08a-4c8c-a762-e4fe845400e3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:34.116742 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-476b54eb-b08a-4c8c-a762-e4fe845400e3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:34.118073 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-476b54eb-b08a-4c8c-a762-e4fe845400e3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:34.119107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-476b54eb-b08a-4c8c-a762-e4fe845400e3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:34.156055 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3406dda3-be85-4ec6-ae77-03af04ada4e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:34.224453 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3406dda3-be85-4ec6-ae77-03af04ada4e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1294 microversion: 2.1 time: 0.259511 Aug 23 22:27:34.231452 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 203/402] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:33 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1294 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:34.251908 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:34.255890 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:34.285695 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:34.287206 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:34.288433 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:34.290592 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:34.294952 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:34.298779 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:34.490660 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-476b54eb-b08a-4c8c-a762-e4fe845400e3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:34.505833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-476b54eb-b08a-4c8c-a762-e4fe845400e3 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1549 microversion: 2.1 time: 0.412898 Aug 23 22:27:34.506627 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 200/403] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:34 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1549 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:34.569169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:34.577375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:34.578427 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Searching by: {'deleted': False, 'project_id': '2cfc99aa2ea246fb845d429885ff5209'} {{(pid=120856) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 22:27:34.591838 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:34.593186 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:34.593850 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:34.594903 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:34.595621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:34.596219 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:34.700035 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:34.709365 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:34.713375 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:34.715010 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d6956884-8ec7-4973-acc4-ffdf493b3cd5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1738 microversion: 2.20 time: 0.481294 Aug 23 22:27:34.716050 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 204/404] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:34 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1738 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:34.748117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.multi_cell_list [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120856) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 22:27:34.955963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4a4e2cea-f109-4cde-8a9e-56fc24e61560 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.411456 Aug 23 22:27:34.956961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 201/405] 10.222.0.88 () {58 vars in 1125 bytes} [Tue Aug 23 22:27:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:27:34.981115 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-dd323519-b18e-40a5-8fd3-2f70b36515a9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:34.985920 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-dd323519-b18e-40a5-8fd3-2f70b36515a9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:35.005365 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cab2c13e-2ee5-4616-9e20-4a97ae6424db tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:35.006448 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cab2c13e-2ee5-4616-9e20-4a97ae6424db tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:35.012938 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd323519-b18e-40a5-8fd3-2f70b36515a9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:35.014162 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd323519-b18e-40a5-8fd3-2f70b36515a9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:35.015387 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd323519-b18e-40a5-8fd3-2f70b36515a9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:35.020428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cab2c13e-2ee5-4616-9e20-4a97ae6424db tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:35.020790 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd323519-b18e-40a5-8fd3-2f70b36515a9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:35.022120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cab2c13e-2ee5-4616-9e20-4a97ae6424db tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:35.023113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cab2c13e-2ee5-4616-9e20-4a97ae6424db tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:35.023674 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd323519-b18e-40a5-8fd3-2f70b36515a9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:35.024741 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-dd323519-b18e-40a5-8fd3-2f70b36515a9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:35.026002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cab2c13e-2ee5-4616-9e20-4a97ae6424db tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:35.027454 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cab2c13e-2ee5-4616-9e20-4a97ae6424db tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:35.028578 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cab2c13e-2ee5-4616-9e20-4a97ae6424db tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:35.259092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-cab2c13e-2ee5-4616-9e20-4a97ae6424db tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:35.278000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cab2c13e-2ee5-4616-9e20-4a97ae6424db tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1306 microversion: 2.1 time: 0.294968 Aug 23 22:27:35.278898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 202/406] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:34 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1306 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:35.287213 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-95d173ae-0188-4756-a155-d1a0a87e1d96 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:35.288167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-95d173ae-0188-4756-a155-d1a0a87e1d96 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:35.315519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d173ae-0188-4756-a155-d1a0a87e1d96 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:35.317717 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d173ae-0188-4756-a155-d1a0a87e1d96 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:35.318705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d173ae-0188-4756-a155-d1a0a87e1d96 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:35.320126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d173ae-0188-4756-a155-d1a0a87e1d96 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:35.326682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d173ae-0188-4756-a155-d1a0a87e1d96 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:35.327601 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95d173ae-0188-4756-a155-d1a0a87e1d96 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:35.330605 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-dd323519-b18e-40a5-8fd3-2f70b36515a9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:35.345842 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-dd323519-b18e-40a5-8fd3-2f70b36515a9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1549 microversion: 2.1 time: 0.373980 Aug 23 22:27:35.347783 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 205/407] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:34 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1549 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:35.754136 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:35.756545 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:35.773322 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:35.775346 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:35.776728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:35.781359 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:35.783419 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:35.784677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:35.854835 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-95d173ae-0188-4756-a155-d1a0a87e1d96 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:35.880405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-95d173ae-0188-4756-a155-d1a0a87e1d96 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1300 microversion: 2.1 time: 0.598088 Aug 23 22:27:35.882063 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 203/408] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:35 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1300 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:36.230635 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:36.253545 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:36.257076 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:36.261389 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-67f494d5-53f9-42c1-b5e5-581250c59589 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1720 microversion: 2.20 time: 0.518047 Aug 23 22:27:36.295555 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 206/409] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:35 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1720 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:36.331761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e116daab-00f1-4d93-aca6-101838afd7de tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:36.335211 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e116daab-00f1-4d93-aca6-101838afd7de tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:36.360887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e116daab-00f1-4d93-aca6-101838afd7de tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:36.361793 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e116daab-00f1-4d93-aca6-101838afd7de tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:36.362555 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e116daab-00f1-4d93-aca6-101838afd7de tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:36.368713 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e116daab-00f1-4d93-aca6-101838afd7de tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:36.371386 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e116daab-00f1-4d93-aca6-101838afd7de tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:36.373390 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e116daab-00f1-4d93-aca6-101838afd7de tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:36.566740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e116daab-00f1-4d93-aca6-101838afd7de tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:36.580417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e116daab-00f1-4d93-aca6-101838afd7de tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1304 microversion: 2.1 time: 0.265481 Aug 23 22:27:36.582342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 204/410] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:36 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1304 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:36.924112 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-1f209655-8f08-43ca-b4d0-15ea581f9126 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:36.926308 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-1f209655-8f08-43ca-b4d0-15ea581f9126 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:36.939965 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1f209655-8f08-43ca-b4d0-15ea581f9126 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:36.940491 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1f209655-8f08-43ca-b4d0-15ea581f9126 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:36.941143 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1f209655-8f08-43ca-b4d0-15ea581f9126 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:36.942599 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1f209655-8f08-43ca-b4d0-15ea581f9126 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:36.943918 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1f209655-8f08-43ca-b4d0-15ea581f9126 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:36.944790 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1f209655-8f08-43ca-b4d0-15ea581f9126 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:37.085708 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-1f209655-8f08-43ca-b4d0-15ea581f9126 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:37.100981 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-1f209655-8f08-43ca-b4d0-15ea581f9126 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1300 microversion: 2.1 time: 0.183315 Aug 23 22:27:37.113933 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 207/411] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:36 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1300 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:37.318773 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:37.322360 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:37.341895 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:37.343512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:37.344757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:37.346455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:37.347830 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:37.349271 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:37.631274 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cfa02efe-2056-462b-94f4-cbcbbd440359 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:37.633957 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-cfa02efe-2056-462b-94f4-cbcbbd440359 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:37.647057 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfa02efe-2056-462b-94f4-cbcbbd440359 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:37.648850 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfa02efe-2056-462b-94f4-cbcbbd440359 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:37.650031 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfa02efe-2056-462b-94f4-cbcbbd440359 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:37.652006 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfa02efe-2056-462b-94f4-cbcbbd440359 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:37.653286 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfa02efe-2056-462b-94f4-cbcbbd440359 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:37.654365 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cfa02efe-2056-462b-94f4-cbcbbd440359 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:37.861143 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-cfa02efe-2056-462b-94f4-cbcbbd440359 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:37.876900 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-cfa02efe-2056-462b-94f4-cbcbbd440359 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1304 microversion: 2.1 time: 0.269198 Aug 23 22:27:37.878896 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 208/412] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:37 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1304 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:37.891326 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e5d8d34b-12a1-453b-a69f-1e7f1256344c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7135e762-c27b-44c2-9cba-700a7efa015a"}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:37.897029 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e5d8d34b-12a1-453b-a69f-1e7f1256344c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:37.910689 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5d8d34b-12a1-453b-a69f-1e7f1256344c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:37.912791 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5d8d34b-12a1-453b-a69f-1e7f1256344c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:37.912791 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5d8d34b-12a1-453b-a69f-1e7f1256344c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:37.913819 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5d8d34b-12a1-453b-a69f-1e7f1256344c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:37.915878 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5d8d34b-12a1-453b-a69f-1e7f1256344c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:37.916568 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e5d8d34b-12a1-453b-a69f-1e7f1256344c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:38.436371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:38.457351 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:38.460717 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:38.463958 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cd882ba8-d6e5-4c17-9ee6-083e7dbe89c5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1720 microversion: 2.20 time: 1.152201 Aug 23 22:27:38.465049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 205/413] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:37 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1720 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:38.496018 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-39474d2d-a7f6-4ea8-aeab-f9607f216b3d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:38.499116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-39474d2d-a7f6-4ea8-aeab-f9607f216b3d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:38.516232 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39474d2d-a7f6-4ea8-aeab-f9607f216b3d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:38.517298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39474d2d-a7f6-4ea8-aeab-f9607f216b3d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:38.517627 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39474d2d-a7f6-4ea8-aeab-f9607f216b3d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:38.518501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39474d2d-a7f6-4ea8-aeab-f9607f216b3d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:38.519334 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39474d2d-a7f6-4ea8-aeab-f9607f216b3d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:38.519853 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39474d2d-a7f6-4ea8-aeab-f9607f216b3d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:38.590106 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e5d8d34b-12a1-453b-a69f-1e7f1256344c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "POST /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707975 Aug 23 22:27:38.591675 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 209/414] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:27:37 2022] POST /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:27:38.725927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-39474d2d-a7f6-4ea8-aeab-f9607f216b3d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:38.745208 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-39474d2d-a7f6-4ea8-aeab-f9607f216b3d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1300 microversion: 2.1 time: 0.261376 Aug 23 22:27:38.746204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 206/415] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:38 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1300 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:38.920042 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-0d6b3857-bb1e-425d-ae0f-9fa8139c9b59 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:38.922115 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-0d6b3857-bb1e-425d-ae0f-9fa8139c9b59 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:38.936897 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0d6b3857-bb1e-425d-ae0f-9fa8139c9b59 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:38.945231 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0d6b3857-bb1e-425d-ae0f-9fa8139c9b59 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:38.947041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0d6b3857-bb1e-425d-ae0f-9fa8139c9b59 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:38.948781 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0d6b3857-bb1e-425d-ae0f-9fa8139c9b59 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:38.950068 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0d6b3857-bb1e-425d-ae0f-9fa8139c9b59 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:38.951205 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0d6b3857-bb1e-425d-ae0f-9fa8139c9b59 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:38.978364 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-9173dccd-5dc9-4593-9ebf-2a295b5920b3 req-76fa1b87-5c7e-4382-aa1c-c4d440ba1c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b697da-19f2-459e-a57e-e386523e4bcf", "name": "network-vif-unplugged", "status": "completed", "tag": "5867c0e1-ac00-4c87-bd75-9ca953635248"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:39.036337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9173dccd-5dc9-4593-9ebf-2a295b5920b3 req-76fa1b87-5c7e-4382-aa1c-c4d440ba1c65 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:39.037763 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9173dccd-5dc9-4593-9ebf-2a295b5920b3 req-76fa1b87-5c7e-4382-aa1c-c4d440ba1c65 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:39.038977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9173dccd-5dc9-4593-9ebf-2a295b5920b3 req-76fa1b87-5c7e-4382-aa1c-c4d440ba1c65 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:39.126188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-9173dccd-5dc9-4593-9ebf-2a295b5920b3 req-76fa1b87-5c7e-4382-aa1c-c4d440ba1c65 service nova] Creating event network-vif-unplugged:5867c0e1-ac00-4c87-bd75-9ca953635248 for instance 80b697da-19f2-459e-a57e-e386523e4bcf on hv-cinder-85032 Aug 23 22:27:39.184319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-9173dccd-5dc9-4593-9ebf-2a295b5920b3 req-76fa1b87-5c7e-4382-aa1c-c4d440ba1c65 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.211035 Aug 23 22:27:39.188016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 207/416] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:27:39.206041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-0d6b3857-bb1e-425d-ae0f-9fa8139c9b59 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:39.248798 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-0d6b3857-bb1e-425d-ae0f-9fa8139c9b59 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1304 microversion: 2.1 time: 0.335686 Aug 23 22:27:39.266637 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 210/417] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:38 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1304 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:39.510067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:39.510994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:39.518930 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:39.519495 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:39.520014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:39.520808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:39.521386 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:39.522084 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:39.774849 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=2 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:39.800163 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-0f28a2e3-b268-48be-8903-cefbae3a6467 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:39.803910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-0f28a2e3-b268-48be-8903-cefbae3a6467 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:39.839312 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0f28a2e3-b268-48be-8903-cefbae3a6467 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:39.845286 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0f28a2e3-b268-48be-8903-cefbae3a6467 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:39.849760 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0f28a2e3-b268-48be-8903-cefbae3a6467 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:39.852715 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0f28a2e3-b268-48be-8903-cefbae3a6467 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:39.858032 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0f28a2e3-b268-48be-8903-cefbae3a6467 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:39.861236 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0f28a2e3-b268-48be-8903-cefbae3a6467 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:39.936703 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:39.986628 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=6 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:40.049388 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:40.065610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:40.068087 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:40.070214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9f7ac427-6dd9-4f9d-91f6-f832f6b9a3f8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1720 microversion: 2.20 time: 0.565601 Aug 23 22:27:40.071886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 208/418] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:39 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1720 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:40.213525 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-0f28a2e3-b268-48be-8903-cefbae3a6467 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:40.250097 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-0f28a2e3-b268-48be-8903-cefbae3a6467 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.478621 Aug 23 22:27:40.251048 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 211/419] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:39 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:40.294442 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9355327e-7480-4ddb-a1e7-369d34c9c4b1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:40.296035 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9355327e-7480-4ddb-a1e7-369d34c9c4b1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:40.316024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9355327e-7480-4ddb-a1e7-369d34c9c4b1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:40.317223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9355327e-7480-4ddb-a1e7-369d34c9c4b1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:40.317965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9355327e-7480-4ddb-a1e7-369d34c9c4b1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:40.319183 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9355327e-7480-4ddb-a1e7-369d34c9c4b1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:40.320172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9355327e-7480-4ddb-a1e7-369d34c9c4b1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:40.320987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9355327e-7480-4ddb-a1e7-369d34c9c4b1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:41.110861 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:41.112031 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:41.123683 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:41.125162 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:41.126217 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:41.127784 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:41.128811 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:41.129677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:41.359051 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=8 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:41.386910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:41.408769 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:41.412719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:41.416622 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8c4921d5-1667-4bdb-b26b-11f3437d4dba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1723 microversion: 2.20 time: 0.311914 Aug 23 22:27:41.418556 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 212/420] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:41 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:27:41.428449 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-9bc974cf-f0ea-406f-89b8-6b8bdf9798ff tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:41.431836 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9bc974cf-f0ea-406f-89b8-6b8bdf9798ff tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:41.443962 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bc974cf-f0ea-406f-89b8-6b8bdf9798ff tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:41.445277 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bc974cf-f0ea-406f-89b8-6b8bdf9798ff tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:41.446995 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bc974cf-f0ea-406f-89b8-6b8bdf9798ff tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:41.449424 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bc974cf-f0ea-406f-89b8-6b8bdf9798ff tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:41.451274 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bc974cf-f0ea-406f-89b8-6b8bdf9798ff tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:41.454040 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9bc974cf-f0ea-406f-89b8-6b8bdf9798ff tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:41.467163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9355327e-7480-4ddb-a1e7-369d34c9c4b1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:41.487362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9355327e-7480-4ddb-a1e7-369d34c9c4b1 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 1.204563 Aug 23 22:27:41.506274 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 209/421] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:40 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:41.527499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-040d4195-a60f-4fdc-b1f4-4636c7b285d9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0069771-bf40-406a-bef2-b913cfacec93"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:41.533698 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-040d4195-a60f-4fdc-b1f4-4636c7b285d9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:41.551254 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-040d4195-a60f-4fdc-b1f4-4636c7b285d9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:41.552842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-040d4195-a60f-4fdc-b1f4-4636c7b285d9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:41.554463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-040d4195-a60f-4fdc-b1f4-4636c7b285d9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:41.557233 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-040d4195-a60f-4fdc-b1f4-4636c7b285d9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:41.559449 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-040d4195-a60f-4fdc-b1f4-4636c7b285d9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:41.560741 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-040d4195-a60f-4fdc-b1f4-4636c7b285d9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:41.897769 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9bc974cf-f0ea-406f-89b8-6b8bdf9798ff tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:41.928514 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-9bc974cf-f0ea-406f-89b8-6b8bdf9798ff tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.506695 Aug 23 22:27:41.931107 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 213/422] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:41 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:42.425473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-040d4195-a60f-4fdc-b1f4-4636c7b285d9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "POST /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.915438 Aug 23 22:27:42.427923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 210/423] 10.222.0.88 () {62 vars in 1364 bytes} [Tue Aug 23 22:27:41 2022] POST /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments => generated 188 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:27:42.536325 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-8ee5482b-4f92-4a85-bd1e-2ed0cfe5ab06 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:42.537894 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-8ee5482b-4f92-4a85-bd1e-2ed0cfe5ab06 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:42.575859 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8ee5482b-4f92-4a85-bd1e-2ed0cfe5ab06 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:42.576804 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8ee5482b-4f92-4a85-bd1e-2ed0cfe5ab06 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:42.582823 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8ee5482b-4f92-4a85-bd1e-2ed0cfe5ab06 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:42.584307 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8ee5482b-4f92-4a85-bd1e-2ed0cfe5ab06 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:42.585452 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8ee5482b-4f92-4a85-bd1e-2ed0cfe5ab06 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:42.587465 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-8ee5482b-4f92-4a85-bd1e-2ed0cfe5ab06 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:42.738125 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-48e9dac7-e9e7-40bc-9ca7-c511ed313875 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:42.739649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-48e9dac7-e9e7-40bc-9ca7-c511ed313875 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:42.752243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-48e9dac7-e9e7-40bc-9ca7-c511ed313875 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:42.753636 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-48e9dac7-e9e7-40bc-9ca7-c511ed313875 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:42.754784 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-48e9dac7-e9e7-40bc-9ca7-c511ed313875 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:42.756479 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-48e9dac7-e9e7-40bc-9ca7-c511ed313875 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:42.757716 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-48e9dac7-e9e7-40bc-9ca7-c511ed313875 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:42.758977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-48e9dac7-e9e7-40bc-9ca7-c511ed313875 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:42.765226 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:42.885207 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-48e9dac7-e9e7-40bc-9ca7-c511ed313875 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120856) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 22:27:42.910532 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-8ee5482b-4f92-4a85-bd1e-2ed0cfe5ab06 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:42.936679 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-8ee5482b-4f92-4a85-bd1e-2ed0cfe5ab06 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.407255 Aug 23 22:27:42.937982 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 214/424] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:42 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:42.966850 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cc0fc834-8f21-442d-afa5-07bcbfa13030 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:42.967865 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-cc0fc834-8f21-442d-afa5-07bcbfa13030 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:42.985724 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc0fc834-8f21-442d-afa5-07bcbfa13030 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:42.989428 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc0fc834-8f21-442d-afa5-07bcbfa13030 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:42.993527 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc0fc834-8f21-442d-afa5-07bcbfa13030 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:42.994800 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc0fc834-8f21-442d-afa5-07bcbfa13030 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:42.995332 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc0fc834-8f21-442d-afa5-07bcbfa13030 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:42.995871 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cc0fc834-8f21-442d-afa5-07bcbfa13030 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:43.027746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-48e9dac7-e9e7-40bc-9ca7-c511ed313875 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "POST /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/action" status: 202 len: 0 microversion: 2.20 time: 0.296417 Aug 23 22:27:43.029314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 211/425] 10.222.0.88 () {62 vars in 1319 bytes} [Tue Aug 23 22:27:42 2022] POST /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:27:43.046018 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:43.047296 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:43.063789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:43.065038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:43.065693 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:43.067589 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:43.068525 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:43.069640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:43.460335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-cc0fc834-8f21-442d-afa5-07bcbfa13030 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:43.480591 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-cc0fc834-8f21-442d-afa5-07bcbfa13030 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.519397 Aug 23 22:27:43.481620 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 215/426] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:42 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:43.506139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-3cad2dd7-11e0-43fc-8366-2073276bdd23 req-703c97e3-b7cb-44fd-9423-abeb1309f71f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b73e6f-743c-4663-9555-2df628611896", "tag": "2fd85c0e-2897-4f7e-bd09-e37d0339fea8"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:43.528561 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-3cad2dd7-11e0-43fc-8366-2073276bdd23 req-703c97e3-b7cb-44fd-9423-abeb1309f71f service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:43.531066 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-3cad2dd7-11e0-43fc-8366-2073276bdd23 req-703c97e3-b7cb-44fd-9423-abeb1309f71f service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:43.533366 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-3cad2dd7-11e0-43fc-8366-2073276bdd23 req-703c97e3-b7cb-44fd-9423-abeb1309f71f service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:43.566640 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-3cad2dd7-11e0-43fc-8366-2073276bdd23 req-703c97e3-b7cb-44fd-9423-abeb1309f71f service nova] Creating event network-changed:2fd85c0e-2897-4f7e-bd09-e37d0339fea8 for instance a5b73e6f-743c-4663-9555-2df628611896 on hv-cinder-85032 Aug 23 22:27:43.576340 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-3cad2dd7-11e0-43fc-8366-2073276bdd23 req-703c97e3-b7cb-44fd-9423-abeb1309f71f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082026 Aug 23 22:27:43.578426 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 216/427] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:27:43.645842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:43.673437 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:43.691950 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:43.694739 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b7ff431e-0a8b-4cde-8649-38be8a252763 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1809 microversion: 2.20 time: 0.659789 Aug 23 22:27:43.697819 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 212/428] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:43 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1809 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:43.988424 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-c79cde24-0436-4451-b631-d4582dedc0f3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:43.989955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-c79cde24-0436-4451-b631-d4582dedc0f3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:44.007045 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c79cde24-0436-4451-b631-d4582dedc0f3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:44.009264 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c79cde24-0436-4451-b631-d4582dedc0f3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:44.010814 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c79cde24-0436-4451-b631-d4582dedc0f3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:44.012596 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c79cde24-0436-4451-b631-d4582dedc0f3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:44.013998 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c79cde24-0436-4451-b631-d4582dedc0f3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:44.015066 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c79cde24-0436-4451-b631-d4582dedc0f3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:44.358838 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c79cde24-0436-4451-b631-d4582dedc0f3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:44.375612 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-c79cde24-0436-4451-b631-d4582dedc0f3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.399733 Aug 23 22:27:44.377293 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 217/429] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:43 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:44.525960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c0ff9d84-0943-426b-b465-770862d31e63 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:44.528297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c0ff9d84-0943-426b-b465-770862d31e63 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:44.542346 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0ff9d84-0943-426b-b465-770862d31e63 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:44.543752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0ff9d84-0943-426b-b465-770862d31e63 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:44.544934 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0ff9d84-0943-426b-b465-770862d31e63 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:44.546609 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0ff9d84-0943-426b-b465-770862d31e63 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:44.548427 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0ff9d84-0943-426b-b465-770862d31e63 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:44.549573 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0ff9d84-0943-426b-b465-770862d31e63 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:44.658676 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:44.745523 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:44.748693 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:44.807394 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:44.808143 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:44.808928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:44.810062 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:44.811153 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:44.811317 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:45.209708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c0ff9d84-0943-426b-b465-770862d31e63 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:45.233656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c0ff9d84-0943-426b-b465-770862d31e63 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.715516 Aug 23 22:27:45.241251 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 213/430] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:44 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:45.293724 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:45.316809 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:45.323337 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:45.325909 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a4a73b3b-c83b-4023-84ab-c52ecc5f7068 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1749 microversion: 2.20 time: 0.591748 Aug 23 22:27:45.327282 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 218/431] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:44 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1749 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:27:45.417657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-38e9ee18-ef90-46f7-a42f-58b17930515f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:45.425925 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-38e9ee18-ef90-46f7-a42f-58b17930515f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:45.453299 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e9ee18-ef90-46f7-a42f-58b17930515f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:45.454134 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e9ee18-ef90-46f7-a42f-58b17930515f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:45.455009 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e9ee18-ef90-46f7-a42f-58b17930515f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:45.456566 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e9ee18-ef90-46f7-a42f-58b17930515f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:45.457364 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e9ee18-ef90-46f7-a42f-58b17930515f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:45.458450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38e9ee18-ef90-46f7-a42f-58b17930515f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:45.700258 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-38b875fd-affc-41ae-bba6-7f828e2f715f req-01db9657-79e8-4912-99cf-5cabbad93e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c1b881-065d-4348-9ce8-50b4cb96585c", "tag": "e22c6f1c-3320-443a-8bec-aafb2744b504"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:45.722737 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-38b875fd-affc-41ae-bba6-7f828e2f715f req-01db9657-79e8-4912-99cf-5cabbad93e6f service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:45.740243 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-38b875fd-affc-41ae-bba6-7f828e2f715f req-01db9657-79e8-4912-99cf-5cabbad93e6f service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:45.741889 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-38b875fd-affc-41ae-bba6-7f828e2f715f req-01db9657-79e8-4912-99cf-5cabbad93e6f service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:45.763113 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-38b875fd-affc-41ae-bba6-7f828e2f715f req-01db9657-79e8-4912-99cf-5cabbad93e6f service nova] Creating event network-changed:e22c6f1c-3320-443a-8bec-aafb2744b504 for instance d1c1b881-065d-4348-9ce8-50b4cb96585c on hv-cinder-85032 Aug 23 22:27:45.772975 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-38b875fd-affc-41ae-bba6-7f828e2f715f req-01db9657-79e8-4912-99cf-5cabbad93e6f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087904 Aug 23 22:27:45.774470 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 219/432] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:27:45.824589 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-38e9ee18-ef90-46f7-a42f-58b17930515f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:45.847935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-38e9ee18-ef90-46f7-a42f-58b17930515f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.434544 Aug 23 22:27:45.849121 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 214/433] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:45 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:46.275342 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-6d67952c-ea7a-415d-937a-121912849163 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:46.276185 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-6d67952c-ea7a-415d-937a-121912849163 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:46.285586 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6d67952c-ea7a-415d-937a-121912849163 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:46.286148 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6d67952c-ea7a-415d-937a-121912849163 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:46.286628 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6d67952c-ea7a-415d-937a-121912849163 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:46.287453 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6d67952c-ea7a-415d-937a-121912849163 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:46.287996 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6d67952c-ea7a-415d-937a-121912849163 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:46.288543 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6d67952c-ea7a-415d-937a-121912849163 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:46.370210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:46.371418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:46.383468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:46.384790 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:46.385690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:46.387049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:46.388185 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:46.389157 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:46.487071 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-6d67952c-ea7a-415d-937a-121912849163 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:46.496493 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-6d67952c-ea7a-415d-937a-121912849163 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.226751 Aug 23 22:27:46.497138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 220/434] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:46 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:46.638790 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:46.659358 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:46.663752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:46.666956 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-59c302de-8043-469f-9458-7b87c6b9fcaa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1749 microversion: 2.20 time: 0.304100 Aug 23 22:27:46.669987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 215/435] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:46 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1749 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:27:46.891833 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-4c7d92d9-19b7-4dca-9b45-8fcd03d1288d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:46.892918 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-4c7d92d9-19b7-4dca-9b45-8fcd03d1288d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:46.904544 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c7d92d9-19b7-4dca-9b45-8fcd03d1288d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:46.905458 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c7d92d9-19b7-4dca-9b45-8fcd03d1288d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:46.906567 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c7d92d9-19b7-4dca-9b45-8fcd03d1288d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:46.907927 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c7d92d9-19b7-4dca-9b45-8fcd03d1288d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:46.908747 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c7d92d9-19b7-4dca-9b45-8fcd03d1288d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:46.909540 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4c7d92d9-19b7-4dca-9b45-8fcd03d1288d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:47.162764 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-4c7d92d9-19b7-4dca-9b45-8fcd03d1288d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:47.179508 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-4c7d92d9-19b7-4dca-9b45-8fcd03d1288d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.294867 Aug 23 22:27:47.181297 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 221/436] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:46 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:47.522628 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8da53aa3-a023-493a-bbac-ceb633171f55 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:47.523453 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8da53aa3-a023-493a-bbac-ceb633171f55 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:47.531786 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8da53aa3-a023-493a-bbac-ceb633171f55 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:47.532522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8da53aa3-a023-493a-bbac-ceb633171f55 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:47.533320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8da53aa3-a023-493a-bbac-ceb633171f55 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:47.534540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8da53aa3-a023-493a-bbac-ceb633171f55 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:47.536431 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8da53aa3-a023-493a-bbac-ceb633171f55 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:47.537818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8da53aa3-a023-493a-bbac-ceb633171f55 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:47.724697 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:47.726083 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:47.737685 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:47.738578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:47.739364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:47.740715 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:47.741601 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:47.742387 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:47.820354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8da53aa3-a023-493a-bbac-ceb633171f55 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:47.833648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8da53aa3-a023-493a-bbac-ceb633171f55 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.316375 Aug 23 22:27:47.834373 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 216/437] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:47 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:47.997450 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:48.016434 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:48.019807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:48.022324 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ae246259-34d4-498f-81d4-80da8ec4383f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1749 microversion: 2.20 time: 0.304775 Aug 23 22:27:48.023374 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 222/438] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:47 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1749 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:27:48.213409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cd526bb4-5908-49c8-8ae6-053c3f598612 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:48.214959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cd526bb4-5908-49c8-8ae6-053c3f598612 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:48.232327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd526bb4-5908-49c8-8ae6-053c3f598612 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:48.233657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd526bb4-5908-49c8-8ae6-053c3f598612 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:48.234509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd526bb4-5908-49c8-8ae6-053c3f598612 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:48.248354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd526bb4-5908-49c8-8ae6-053c3f598612 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:48.256773 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd526bb4-5908-49c8-8ae6-053c3f598612 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:48.258845 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd526bb4-5908-49c8-8ae6-053c3f598612 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:48.612238 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-cd526bb4-5908-49c8-8ae6-053c3f598612 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:48.624129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cd526bb4-5908-49c8-8ae6-053c3f598612 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.419674 Aug 23 22:27:48.624960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 217/439] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:48 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:48.869101 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-6398c423-fc7b-47a5-90e7-df4e13deaa72 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:48.870057 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-6398c423-fc7b-47a5-90e7-df4e13deaa72 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:48.881301 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6398c423-fc7b-47a5-90e7-df4e13deaa72 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:48.882109 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6398c423-fc7b-47a5-90e7-df4e13deaa72 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:48.883357 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6398c423-fc7b-47a5-90e7-df4e13deaa72 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:48.884576 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6398c423-fc7b-47a5-90e7-df4e13deaa72 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:48.885391 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6398c423-fc7b-47a5-90e7-df4e13deaa72 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:48.886044 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6398c423-fc7b-47a5-90e7-df4e13deaa72 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:49.069125 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:49.069955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:49.083398 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:49.084945 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:49.086654 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:49.087887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:49.088383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:49.088821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:49.408932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:49.438182 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:49.444375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:49.448840 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5b9062ba-5895-437b-82b9-d6b02427b4c1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1751 microversion: 2.20 time: 0.383629 Aug 23 22:27:49.451834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 218/440] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:49 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1751 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:27:49.520559 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-6398c423-fc7b-47a5-90e7-df4e13deaa72 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:49.543182 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-6398c423-fc7b-47a5-90e7-df4e13deaa72 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.681248 Aug 23 22:27:49.545565 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 223/441] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:48 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:49.655722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-578e9760-a23c-427a-9a5e-372ea7a3bc2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:49.658314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-578e9760-a23c-427a-9a5e-372ea7a3bc2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:49.674900 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-578e9760-a23c-427a-9a5e-372ea7a3bc2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:49.675897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-578e9760-a23c-427a-9a5e-372ea7a3bc2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:49.676792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-578e9760-a23c-427a-9a5e-372ea7a3bc2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:49.678426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-578e9760-a23c-427a-9a5e-372ea7a3bc2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:49.679991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-578e9760-a23c-427a-9a5e-372ea7a3bc2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:49.682098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-578e9760-a23c-427a-9a5e-372ea7a3bc2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:50.115149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-578e9760-a23c-427a-9a5e-372ea7a3bc2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:50.138106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-578e9760-a23c-427a-9a5e-372ea7a3bc2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.490830 Aug 23 22:27:50.158171 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 219/442] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:49 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:50.495014 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:50.496088 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:50.510417 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:50.511328 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:50.512186 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:50.513743 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:50.514643 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:50.516760 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:50.582890 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7c2aff06-1e38-457c-b9c5-8597897c6d0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:50.583404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7c2aff06-1e38-457c-b9c5-8597897c6d0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:50.602300 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c2aff06-1e38-457c-b9c5-8597897c6d0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:50.603421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c2aff06-1e38-457c-b9c5-8597897c6d0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:50.604228 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c2aff06-1e38-457c-b9c5-8597897c6d0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:50.605711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c2aff06-1e38-457c-b9c5-8597897c6d0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:50.606588 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c2aff06-1e38-457c-b9c5-8597897c6d0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:50.607509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c2aff06-1e38-457c-b9c5-8597897c6d0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:50.745301 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:50.762507 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:50.765802 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:50.768043 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-370cc163-9f25-4987-a985-68574ce4a358 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1751 microversion: 2.20 time: 0.282226 Aug 23 22:27:50.769462 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 224/443] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:50 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1751 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:50.848994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7c2aff06-1e38-457c-b9c5-8597897c6d0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:50.859847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7c2aff06-1e38-457c-b9c5-8597897c6d0d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.283195 Aug 23 22:27:50.860668 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 220/444] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:50 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:51.175955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-6cbb90c7-0f46-4dcd-b7c6-f67cd2d16cf0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:51.177195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-6cbb90c7-0f46-4dcd-b7c6-f67cd2d16cf0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:51.189610 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6cbb90c7-0f46-4dcd-b7c6-f67cd2d16cf0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:51.190503 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6cbb90c7-0f46-4dcd-b7c6-f67cd2d16cf0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:51.191662 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6cbb90c7-0f46-4dcd-b7c6-f67cd2d16cf0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:51.193559 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6cbb90c7-0f46-4dcd-b7c6-f67cd2d16cf0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:51.194834 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6cbb90c7-0f46-4dcd-b7c6-f67cd2d16cf0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:51.196614 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-6cbb90c7-0f46-4dcd-b7c6-f67cd2d16cf0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:51.434088 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-6cbb90c7-0f46-4dcd-b7c6-f67cd2d16cf0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:51.447777 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-6cbb90c7-0f46-4dcd-b7c6-f67cd2d16cf0 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.279027 Aug 23 22:27:51.448416 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 225/445] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:51 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:51.803587 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:51.804346 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:51.813498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:51.813870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:51.814282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:51.815163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:51.816881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:51.816881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:51.884933 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-510b59fd-5718-426b-9961-e09ee276bf07 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:51.885724 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-510b59fd-5718-426b-9961-e09ee276bf07 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:51.892984 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-510b59fd-5718-426b-9961-e09ee276bf07 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:51.893512 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-510b59fd-5718-426b-9961-e09ee276bf07 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:51.893945 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-510b59fd-5718-426b-9961-e09ee276bf07 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:51.894660 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-510b59fd-5718-426b-9961-e09ee276bf07 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:51.895107 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-510b59fd-5718-426b-9961-e09ee276bf07 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:51.895528 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-510b59fd-5718-426b-9961-e09ee276bf07 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:52.037825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:52.057094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:52.060436 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:52.062839 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7278d615-f556-4cd2-ba69-11f6888b867e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1751 microversion: 2.20 time: 0.265172 Aug 23 22:27:52.064236 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 221/446] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:51 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1751 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:52.089450 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-510b59fd-5718-426b-9961-e09ee276bf07 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:52.105513 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-510b59fd-5718-426b-9961-e09ee276bf07 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.224854 Aug 23 22:27:52.106382 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 226/447] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:51 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:52.473487 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ca92beda-fe3b-416b-be23-bf00d57cc078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:52.474326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ca92beda-fe3b-416b-be23-bf00d57cc078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:52.483452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ca92beda-fe3b-416b-be23-bf00d57cc078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:52.484165 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ca92beda-fe3b-416b-be23-bf00d57cc078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:52.484706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ca92beda-fe3b-416b-be23-bf00d57cc078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:52.485748 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ca92beda-fe3b-416b-be23-bf00d57cc078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:52.486340 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ca92beda-fe3b-416b-be23-bf00d57cc078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:52.487086 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ca92beda-fe3b-416b-be23-bf00d57cc078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:52.669306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ca92beda-fe3b-416b-be23-bf00d57cc078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:52.677630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ca92beda-fe3b-416b-be23-bf00d57cc078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.209193 Aug 23 22:27:52.678236 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 222/448] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:52 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:53.110950 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:53.111758 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:53.119890 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:53.120616 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:53.121133 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:53.121874 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:53.122335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:53.122765 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:53.138668 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f88bc620-b855-44a8-8f55-20e50ada3c3c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:53.139788 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f88bc620-b855-44a8-8f55-20e50ada3c3c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:53.150543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f88bc620-b855-44a8-8f55-20e50ada3c3c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:53.151290 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f88bc620-b855-44a8-8f55-20e50ada3c3c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:53.152077 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f88bc620-b855-44a8-8f55-20e50ada3c3c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:53.153362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f88bc620-b855-44a8-8f55-20e50ada3c3c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:53.154384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f88bc620-b855-44a8-8f55-20e50ada3c3c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:53.155319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f88bc620-b855-44a8-8f55-20e50ada3c3c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:53.407869 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:53.427723 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:53.431483 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:53.433723 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-1dc69f06-857e-4b70-b9b8-fe738f3ff22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1751 microversion: 2.20 time: 0.328441 Aug 23 22:27:53.434747 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 227/449] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:53 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1751 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:53.606970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f88bc620-b855-44a8-8f55-20e50ada3c3c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:53.623355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f88bc620-b855-44a8-8f55-20e50ada3c3c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.490458 Aug 23 22:27:53.642248 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 223/450] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:53 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:53.704505 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7d595ed0-fab2-40a7-b16a-0e9657b065fc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:53.705700 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7d595ed0-fab2-40a7-b16a-0e9657b065fc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:53.717836 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d595ed0-fab2-40a7-b16a-0e9657b065fc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:53.719058 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d595ed0-fab2-40a7-b16a-0e9657b065fc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:53.719778 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d595ed0-fab2-40a7-b16a-0e9657b065fc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:53.721018 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d595ed0-fab2-40a7-b16a-0e9657b065fc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:53.721825 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d595ed0-fab2-40a7-b16a-0e9657b065fc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:53.722537 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d595ed0-fab2-40a7-b16a-0e9657b065fc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:54.001659 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7d595ed0-fab2-40a7-b16a-0e9657b065fc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:54.021385 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7d595ed0-fab2-40a7-b16a-0e9657b065fc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.316518 Aug 23 22:27:54.021385 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 228/451] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:53 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:54.477349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:54.478890 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:54.490781 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:54.491730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:54.493219 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:54.494450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:54.495256 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:54.496021 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:54.661680 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bcbcf7da-0d68-4dda-97bb-934d19b3eeb8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:54.663812 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-bcbcf7da-0d68-4dda-97bb-934d19b3eeb8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:54.676649 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bcbcf7da-0d68-4dda-97bb-934d19b3eeb8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:54.677596 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bcbcf7da-0d68-4dda-97bb-934d19b3eeb8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:54.678401 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bcbcf7da-0d68-4dda-97bb-934d19b3eeb8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:54.681965 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bcbcf7da-0d68-4dda-97bb-934d19b3eeb8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:54.682960 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bcbcf7da-0d68-4dda-97bb-934d19b3eeb8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:54.684033 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bcbcf7da-0d68-4dda-97bb-934d19b3eeb8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:54.725647 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=100 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:54.780767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:54.805939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:54.809849 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:54.813044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6030a194-853c-4b4a-b492-067aa0736014 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1751 microversion: 2.20 time: 0.343635 Aug 23 22:27:54.814651 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 224/452] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:54 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1751 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:54.962116 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-bcbcf7da-0d68-4dda-97bb-934d19b3eeb8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:54.971813 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-bcbcf7da-0d68-4dda-97bb-934d19b3eeb8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.316700 Aug 23 22:27:54.972228 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 229/453] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:54 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:55.037700 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-73119774-2468-44be-8e5d-88d1b572719b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:55.038360 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-73119774-2468-44be-8e5d-88d1b572719b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:55.048877 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73119774-2468-44be-8e5d-88d1b572719b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:55.049211 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73119774-2468-44be-8e5d-88d1b572719b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:55.049677 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73119774-2468-44be-8e5d-88d1b572719b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:55.050477 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73119774-2468-44be-8e5d-88d1b572719b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:55.051322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73119774-2468-44be-8e5d-88d1b572719b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:55.052033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-73119774-2468-44be-8e5d-88d1b572719b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:55.399178 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-73119774-2468-44be-8e5d-88d1b572719b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:55.422582 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-73119774-2468-44be-8e5d-88d1b572719b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.388721 Aug 23 22:27:55.424118 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 225/454] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:55 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:55.478747 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-e1d63276-e6ce-44cd-8a54-520a7b877120 req-fd1fb9f7-fc6a-4140-adce-576b5f010607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c1b881-065d-4348-9ce8-50b4cb96585c", "name": "network-vif-plugged", "status": "completed", "tag": "e22c6f1c-3320-443a-8bec-aafb2744b504"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:27:55.507365 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:55.511752 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-e1d63276-e6ce-44cd-8a54-520a7b877120 req-fd1fb9f7-fc6a-4140-adce-576b5f010607 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:55.512700 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-e1d63276-e6ce-44cd-8a54-520a7b877120 req-fd1fb9f7-fc6a-4140-adce-576b5f010607 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:55.513823 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-e1d63276-e6ce-44cd-8a54-520a7b877120 req-fd1fb9f7-fc6a-4140-adce-576b5f010607 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:55.544436 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-e1d63276-e6ce-44cd-8a54-520a7b877120 req-fd1fb9f7-fc6a-4140-adce-576b5f010607 service nova] Creating event network-vif-plugged:e22c6f1c-3320-443a-8bec-aafb2744b504 for instance d1c1b881-065d-4348-9ce8-50b4cb96585c on hv-cinder-85032 Aug 23 22:27:55.557604 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-e1d63276-e6ce-44cd-8a54-520a7b877120 req-fd1fb9f7-fc6a-4140-adce-576b5f010607 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087105 Aug 23 22:27:55.558671 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 230/455] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:27:55.858835 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:55.859437 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:55.877834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:55.880412 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:55.881295 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:55.884027 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:55.886751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:55.889844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:55.999090 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-26682ec6-abda-4c15-bd44-2db91a1b78dc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:56.001003 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-26682ec6-abda-4c15-bd44-2db91a1b78dc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:56.010548 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26682ec6-abda-4c15-bd44-2db91a1b78dc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:56.010975 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26682ec6-abda-4c15-bd44-2db91a1b78dc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:56.011416 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26682ec6-abda-4c15-bd44-2db91a1b78dc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:56.012161 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26682ec6-abda-4c15-bd44-2db91a1b78dc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:56.012629 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26682ec6-abda-4c15-bd44-2db91a1b78dc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:56.013048 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-26682ec6-abda-4c15-bd44-2db91a1b78dc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:56.198111 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-26682ec6-abda-4c15-bd44-2db91a1b78dc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:56.212672 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-26682ec6-abda-4c15-bd44-2db91a1b78dc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.217557 Aug 23 22:27:56.214169 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 231/456] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:55 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:56.436111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:56.442731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:56.460545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:56.463349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:56.465247 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8a1a4e09-b22e-4393-a648-2f173ef1c919 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1751 microversion: 2.20 time: 0.616288 Aug 23 22:27:56.466867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 226/457] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:55 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1751 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:56.473364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-54d136d7-d2bb-445d-968d-e1ede27e900b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:56.474275 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-54d136d7-d2bb-445d-968d-e1ede27e900b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:56.484164 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-54d136d7-d2bb-445d-968d-e1ede27e900b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:56.484657 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-54d136d7-d2bb-445d-968d-e1ede27e900b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:56.485327 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-54d136d7-d2bb-445d-968d-e1ede27e900b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:56.485851 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-54d136d7-d2bb-445d-968d-e1ede27e900b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:56.486336 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-54d136d7-d2bb-445d-968d-e1ede27e900b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:56.486762 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-54d136d7-d2bb-445d-968d-e1ede27e900b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:56.622231 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d87754f6-f8fe-4957-a566-a3341a4869d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:56.624023 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d87754f6-f8fe-4957-a566-a3341a4869d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:56.631686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d87754f6-f8fe-4957-a566-a3341a4869d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:56.632152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d87754f6-f8fe-4957-a566-a3341a4869d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:56.633914 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d87754f6-f8fe-4957-a566-a3341a4869d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:56.634967 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d87754f6-f8fe-4957-a566-a3341a4869d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:56.635921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d87754f6-f8fe-4957-a566-a3341a4869d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:56.636498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d87754f6-f8fe-4957-a566-a3341a4869d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:56.729843 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-54d136d7-d2bb-445d-968d-e1ede27e900b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:56.750257 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-54d136d7-d2bb-445d-968d-e1ede27e900b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.292395 Aug 23 22:27:56.753155 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 232/458] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:56 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:56.878755 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d87754f6-f8fe-4957-a566-a3341a4869d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:56.893423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d87754f6-f8fe-4957-a566-a3341a4869d7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1595 microversion: 2.1 time: 0.277570 Aug 23 22:27:56.894561 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 227/459] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:56 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1595 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:27:57.252631 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-fccc7b26-d95c-4c50-954c-44e59b343bc6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:57.257108 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-fccc7b26-d95c-4c50-954c-44e59b343bc6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:57.274345 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fccc7b26-d95c-4c50-954c-44e59b343bc6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:57.275941 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fccc7b26-d95c-4c50-954c-44e59b343bc6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:57.277497 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fccc7b26-d95c-4c50-954c-44e59b343bc6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:57.279550 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fccc7b26-d95c-4c50-954c-44e59b343bc6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:57.280451 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fccc7b26-d95c-4c50-954c-44e59b343bc6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:57.281258 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-fccc7b26-d95c-4c50-954c-44e59b343bc6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:57.495994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:57.497544 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:57.510200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:57.511726 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:57.512754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:57.514511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:57.517173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:57.517173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:57.960245 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:57.987376 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:57.998166 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-fccc7b26-d95c-4c50-954c-44e59b343bc6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:58.001838 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:58.004109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7b1b3911-c278-4afc-a323-0bc7b686970b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1751 microversion: 2.20 time: 0.515823 Aug 23 22:27:58.010695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 228/460] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:57 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1751 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:58.035034 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-fccc7b26-d95c-4c50-954c-44e59b343bc6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.800836 Aug 23 22:27:58.036578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 233/461] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:57 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:58.044266 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f79d5f1c-4db7-440e-97c8-6d3f5634d870 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:58.049765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f79d5f1c-4db7-440e-97c8-6d3f5634d870 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:58.082988 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f79d5f1c-4db7-440e-97c8-6d3f5634d870 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:58.083920 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f79d5f1c-4db7-440e-97c8-6d3f5634d870 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:58.084722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f79d5f1c-4db7-440e-97c8-6d3f5634d870 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:58.087223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f79d5f1c-4db7-440e-97c8-6d3f5634d870 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:58.088145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f79d5f1c-4db7-440e-97c8-6d3f5634d870 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:58.088890 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f79d5f1c-4db7-440e-97c8-6d3f5634d870 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:58.437680 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f79d5f1c-4db7-440e-97c8-6d3f5634d870 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:58.464329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f79d5f1c-4db7-440e-97c8-6d3f5634d870 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1372 microversion: 2.1 time: 0.451646 Aug 23 22:27:58.465641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 229/462] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:58 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1372 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:59.079004 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:59.081330 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:59.081599 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4bbfb3c6-f5ba-4791-a69d-a4205c4da269 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:59.082688 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4bbfb3c6-f5ba-4791-a69d-a4205c4da269 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:59.096483 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:59.098033 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:59.099332 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:59.101696 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:59.103307 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:59.104962 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bbfb3c6-f5ba-4791-a69d-a4205c4da269 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:59.106311 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bbfb3c6-f5ba-4791-a69d-a4205c4da269 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:59.107246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bbfb3c6-f5ba-4791-a69d-a4205c4da269 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:59.108229 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:59.108523 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bbfb3c6-f5ba-4791-a69d-a4205c4da269 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:59.110576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bbfb3c6-f5ba-4791-a69d-a4205c4da269 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:59.111922 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4bbfb3c6-f5ba-4791-a69d-a4205c4da269 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:59.674919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4bbfb3c6-f5ba-4791-a69d-a4205c4da269 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:59.686894 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:59.713697 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:59.719279 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:27:59.722472 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-183f1956-5594-4ea0-ac61-ab1a3d50f4ba tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.651792 Aug 23 22:27:59.725002 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 234/463] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:27:59 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:27:59.725429 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4bbfb3c6-f5ba-4791-a69d-a4205c4da269 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.649104 Aug 23 22:27:59.729701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 230/464] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:59 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:27:59.738700 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-229e7456-0c50-441c-b8dc-434ab1cad567 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:27:59.741399 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-229e7456-0c50-441c-b8dc-434ab1cad567 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:27:59.790018 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-229e7456-0c50-441c-b8dc-434ab1cad567 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:59.790899 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-229e7456-0c50-441c-b8dc-434ab1cad567 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:59.791626 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-229e7456-0c50-441c-b8dc-434ab1cad567 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:27:59.795860 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-229e7456-0c50-441c-b8dc-434ab1cad567 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:27:59.798876 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-229e7456-0c50-441c-b8dc-434ab1cad567 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:27:59.803136 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-229e7456-0c50-441c-b8dc-434ab1cad567 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:00.018891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-493f19d4-e86b-4a6c-ab34-22d2e3f4b804 req-dec81a43-a676-4233-93f7-a6a1573eaf6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b73e6f-743c-4663-9555-2df628611896", "name": "network-vif-plugged", "status": "completed", "tag": "2fd85c0e-2897-4f7e-bd09-e37d0339fea8"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:00.078206 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-493f19d4-e86b-4a6c-ab34-22d2e3f4b804 req-dec81a43-a676-4233-93f7-a6a1573eaf6a service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:00.079490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-493f19d4-e86b-4a6c-ab34-22d2e3f4b804 req-dec81a43-a676-4233-93f7-a6a1573eaf6a service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:00.080505 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-493f19d4-e86b-4a6c-ab34-22d2e3f4b804 req-dec81a43-a676-4233-93f7-a6a1573eaf6a service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:00.120074 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-493f19d4-e86b-4a6c-ab34-22d2e3f4b804 req-dec81a43-a676-4233-93f7-a6a1573eaf6a service nova] Creating event network-vif-plugged:2fd85c0e-2897-4f7e-bd09-e37d0339fea8 for instance a5b73e6f-743c-4663-9555-2df628611896 on hv-cinder-85032 Aug 23 22:28:00.148682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-493f19d4-e86b-4a6c-ab34-22d2e3f4b804 req-dec81a43-a676-4233-93f7-a6a1573eaf6a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136749 Aug 23 22:28:00.151481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 231/465] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:28:00.301192 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-229e7456-0c50-441c-b8dc-434ab1cad567 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:00.335356 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-229e7456-0c50-441c-b8dc-434ab1cad567 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1567 microversion: 2.1 time: 0.606252 Aug 23 22:28:00.340232 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 235/466] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:27:59 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1567 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:00.397135 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-98acf8bf-ff2f-4b9a-815b-50e549428e2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:00.398655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-98acf8bf-ff2f-4b9a-815b-50e549428e2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:00.449916 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-98acf8bf-ff2f-4b9a-815b-50e549428e2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:00.454838 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-98acf8bf-ff2f-4b9a-815b-50e549428e2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:00.457492 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-98acf8bf-ff2f-4b9a-815b-50e549428e2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:00.462230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-98acf8bf-ff2f-4b9a-815b-50e549428e2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:00.465951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-98acf8bf-ff2f-4b9a-815b-50e549428e2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:00.467526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-98acf8bf-ff2f-4b9a-815b-50e549428e2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:00.783308 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-1b9da60c-0042-4952-af65-792ea39ee979 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:00.789202 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-1b9da60c-0042-4952-af65-792ea39ee979 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:00.819266 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1b9da60c-0042-4952-af65-792ea39ee979 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:00.821285 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1b9da60c-0042-4952-af65-792ea39ee979 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:00.822460 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1b9da60c-0042-4952-af65-792ea39ee979 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:00.824215 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1b9da60c-0042-4952-af65-792ea39ee979 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:00.826013 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1b9da60c-0042-4952-af65-792ea39ee979 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:00.827226 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1b9da60c-0042-4952-af65-792ea39ee979 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:00.845508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-98acf8bf-ff2f-4b9a-815b-50e549428e2a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.469917 Aug 23 22:28:00.846617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 232/467] 10.222.0.88 () {58 vars in 1275 bytes} [Tue Aug 23 22:28:00 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-interface => generated 285 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:28:00.860895 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:00.864570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:00.892313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:00.893794 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:00.895095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:00.896795 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:00.900771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:00.906119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:01.481096 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-1b9da60c-0042-4952-af65-792ea39ee979 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:01.500144 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-1b9da60c-0042-4952-af65-792ea39ee979 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.726625 Aug 23 22:28:01.518262 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 236/468] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:00 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:01.892675 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:01.908343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:01.911270 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:01.913081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-871ad73e-325c-4d82-98c4-c8ca43e462bb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 1.064699 Aug 23 22:28:01.937101 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 233/469] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:00 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:02.548311 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-946ab284-eea3-41f2-b3bd-c14a7e83fa89 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:02.550682 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-946ab284-eea3-41f2-b3bd-c14a7e83fa89 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:02.567164 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-946ab284-eea3-41f2-b3bd-c14a7e83fa89 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:02.568675 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-946ab284-eea3-41f2-b3bd-c14a7e83fa89 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:02.570815 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-946ab284-eea3-41f2-b3bd-c14a7e83fa89 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:02.573281 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-946ab284-eea3-41f2-b3bd-c14a7e83fa89 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:02.574713 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-946ab284-eea3-41f2-b3bd-c14a7e83fa89 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:02.576236 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-946ab284-eea3-41f2-b3bd-c14a7e83fa89 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:02.958684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:03.001933 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:03.017632 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:03.020671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:03.023100 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:03.024953 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:03.026671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:03.027660 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:03.028588 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:03.455338 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-946ab284-eea3-41f2-b3bd-c14a7e83fa89 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:03.484941 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-946ab284-eea3-41f2-b3bd-c14a7e83fa89 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1367 microversion: 2.1 time: 0.948620 Aug 23 22:28:03.491548 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 237/470] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:02 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1367 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:03.535742 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-6801d32a-4f50-43ab-a1fc-01a5202ea2c0 req-7df31243-69b9-4889-be63-51b7d5b50f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30f307e-cf90-4c02-ab66-f16d7bc4b427", "tag": "e9f61e27-4256-4ba2-904d-a608368e989b"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:03.580924 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-6801d32a-4f50-43ab-a1fc-01a5202ea2c0 req-7df31243-69b9-4889-be63-51b7d5b50f56 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:03.582577 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-6801d32a-4f50-43ab-a1fc-01a5202ea2c0 req-7df31243-69b9-4889-be63-51b7d5b50f56 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:03.583447 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-6801d32a-4f50-43ab-a1fc-01a5202ea2c0 req-7df31243-69b9-4889-be63-51b7d5b50f56 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:03.643795 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:03.659397 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-6801d32a-4f50-43ab-a1fc-01a5202ea2c0 req-7df31243-69b9-4889-be63-51b7d5b50f56 service nova] Creating event network-changed:e9f61e27-4256-4ba2-904d-a608368e989b for instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 on hv-cinder-85032 Aug 23 22:28:03.678511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:03.689417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:03.691282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-74407289-53e8-4f72-a0d8-6fc4a67b6432 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.744562 Aug 23 22:28:03.711806 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-6801d32a-4f50-43ab-a1fc-01a5202ea2c0 req-7df31243-69b9-4889-be63-51b7d5b50f56 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159627 Aug 23 22:28:03.712978 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 238/471] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:28:03.725637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 234/472] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:02 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:28:04.532225 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-69d9918a-4451-4e7b-a5b3-96620d643123 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:04.533533 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-69d9918a-4451-4e7b-a5b3-96620d643123 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:04.560272 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69d9918a-4451-4e7b-a5b3-96620d643123 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:04.568561 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69d9918a-4451-4e7b-a5b3-96620d643123 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:04.570315 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69d9918a-4451-4e7b-a5b3-96620d643123 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:04.572964 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69d9918a-4451-4e7b-a5b3-96620d643123 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:04.577511 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69d9918a-4451-4e7b-a5b3-96620d643123 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:04.580567 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-69d9918a-4451-4e7b-a5b3-96620d643123 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:04.751690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:04.758999 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:04.798073 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:04.799249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:04.800067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:04.802543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:04.803418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:04.808193 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:05.274236 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-69d9918a-4451-4e7b-a5b3-96620d643123 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:05.321608 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-69d9918a-4451-4e7b-a5b3-96620d643123 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1557 microversion: 2.1 time: 0.795815 Aug 23 22:28:05.325604 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 239/473] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:04 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1557 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:05.373822 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-cc026cdb-c1b2-4237-8d1f-d69e163a303c req-5e0f8285-9fdc-4b60-ae37-ae5397c1dbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c1b881-065d-4348-9ce8-50b4cb96585c", "tag": "e22c6f1c-3320-443a-8bec-aafb2744b504"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:05.399218 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-cc026cdb-c1b2-4237-8d1f-d69e163a303c req-5e0f8285-9fdc-4b60-ae37-ae5397c1dbc2 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:05.400520 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-cc026cdb-c1b2-4237-8d1f-d69e163a303c req-5e0f8285-9fdc-4b60-ae37-ae5397c1dbc2 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:05.401624 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-cc026cdb-c1b2-4237-8d1f-d69e163a303c req-5e0f8285-9fdc-4b60-ae37-ae5397c1dbc2 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:05.467364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-cc026cdb-c1b2-4237-8d1f-d69e163a303c req-5e0f8285-9fdc-4b60-ae37-ae5397c1dbc2 service nova] Creating event network-changed:e22c6f1c-3320-443a-8bec-aafb2744b504 for instance d1c1b881-065d-4348-9ce8-50b4cb96585c on hv-cinder-85032 Aug 23 22:28:05.490564 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-cc026cdb-c1b2-4237-8d1f-d69e163a303c req-5e0f8285-9fdc-4b60-ae37-ae5397c1dbc2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159551 Aug 23 22:28:05.495749 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 240/474] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:28:05.527052 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-60111bd4-41d3-4a12-8141-18fc62b28770 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:05.528243 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-60111bd4-41d3-4a12-8141-18fc62b28770 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:05.560774 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-60111bd4-41d3-4a12-8141-18fc62b28770 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:05.564973 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-60111bd4-41d3-4a12-8141-18fc62b28770 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:05.567524 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-60111bd4-41d3-4a12-8141-18fc62b28770 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:05.568888 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-60111bd4-41d3-4a12-8141-18fc62b28770 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:05.573827 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-60111bd4-41d3-4a12-8141-18fc62b28770 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:05.577508 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-60111bd4-41d3-4a12-8141-18fc62b28770 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:06.065824 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-60111bd4-41d3-4a12-8141-18fc62b28770 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.563475 Aug 23 22:28:06.080656 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 241/475] 10.222.0.88 () {58 vars in 1275 bytes} [Tue Aug 23 22:28:05 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896/os-interface => generated 285 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:28:07.052506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:07.082249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:07.110792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:07.112409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0f4fdf43-f53f-4677-9705-24ade338ae32 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 2.371889 Aug 23 22:28:07.124564 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 235/476] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:04 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 2385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:08.179610 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:08.193808 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:08.237630 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:08.240658 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:08.242208 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:08.245159 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:08.246410 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:08.247937 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:09.733735 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:09.797505 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:09.807800 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:09.810298 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-73af7939-94f8-4750-8438-b6ac36f6a1dc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 1.648325 Aug 23 22:28:09.855926 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 242/477] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:08 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:10.888470 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:10.892750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:10.933146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:10.936682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:10.940146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:10.947548 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:10.947548 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:10.959195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-35e67967-8007-4361-8b4c-378b27557aa7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1688991145"}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:10.967909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:10.975200 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-35e67967-8007-4361-8b4c-378b27557aa7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:11.029125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-35e67967-8007-4361-8b4c-378b27557aa7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:11.030863 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-35e67967-8007-4361-8b4c-378b27557aa7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:11.034807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-35e67967-8007-4361-8b4c-378b27557aa7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:11.040342 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-35e67967-8007-4361-8b4c-378b27557aa7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:11.041897 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-35e67967-8007-4361-8b4c-378b27557aa7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:11.043414 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-35e67967-8007-4361-8b4c-378b27557aa7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:11.517265 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:11.539228 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:11.543401 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:11.546126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-35f230b7-7f44-414c-9e35-2a8db8377990 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.688997 Aug 23 22:28:11.558120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 236/478] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:10 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:11.892210 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.network.security_group_api [None req-35e67967-8007-4361-8b4c-378b27557aa7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Adding security group aa6ccaf7-521c-4684-8cc3-34c22f4fb4a3 to port e9f61e27-4256-4ba2-904d-a608368e989b Aug 23 22:28:12.346615 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-ac87e636-e3d2-48e0-b056-61b6c0b6828e req-1813aae7-d456-4b68-9f85-1fe5d6c93548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b73e6f-743c-4663-9555-2df628611896", "tag": "2fd85c0e-2897-4f7e-bd09-e37d0339fea8"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:12.423612 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-ac87e636-e3d2-48e0-b056-61b6c0b6828e req-1813aae7-d456-4b68-9f85-1fe5d6c93548 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:12.424589 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-ac87e636-e3d2-48e0-b056-61b6c0b6828e req-1813aae7-d456-4b68-9f85-1fe5d6c93548 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:12.426137 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-ac87e636-e3d2-48e0-b056-61b6c0b6828e req-1813aae7-d456-4b68-9f85-1fe5d6c93548 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:12.509148 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-ac87e636-e3d2-48e0-b056-61b6c0b6828e req-1813aae7-d456-4b68-9f85-1fe5d6c93548 service nova] Creating event network-changed:2fd85c0e-2897-4f7e-bd09-e37d0339fea8 for instance a5b73e6f-743c-4663-9555-2df628611896 on hv-cinder-85032 Aug 23 22:28:12.523735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-ac87e636-e3d2-48e0-b056-61b6c0b6828e req-1813aae7-d456-4b68-9f85-1fe5d6c93548 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198462 Aug 23 22:28:12.525792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 237/479] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:28:12.600650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:12.625581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:12.661339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:12.663153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:12.673094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:12.677637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:12.680829 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:12.687212 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:13.600271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-35e67967-8007-4361-8b4c-378b27557aa7 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "POST /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/action" status: 202 len: 0 microversion: 2.1 time: 2.649053 Aug 23 22:28:13.604160 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 243/480] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:28:10 2022] POST /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/action => generated 0 bytes in 2656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:28:13.627424 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-21ed6d33-b8e1-4f10-a89c-f33c1647b099 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:13.631125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-21ed6d33-b8e1-4f10-a89c-f33c1647b099 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:13.651011 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-21ed6d33-b8e1-4f10-a89c-f33c1647b099 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:13.653155 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-21ed6d33-b8e1-4f10-a89c-f33c1647b099 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:13.655636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-21ed6d33-b8e1-4f10-a89c-f33c1647b099 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:13.659081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:13.661454 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-21ed6d33-b8e1-4f10-a89c-f33c1647b099 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:13.662977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-21ed6d33-b8e1-4f10-a89c-f33c1647b099 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:13.665926 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-21ed6d33-b8e1-4f10-a89c-f33c1647b099 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:13.704048 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:13.728217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:13.731453 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fd8e2b80-fe1e-48f2-b2f5-7c3aa2839ff1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 1.143312 Aug 23 22:28:13.738251 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 238/481] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:12 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:13.765720 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-943af632-7924-467d-91a7-1e652e7584fa tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:13.767350 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-943af632-7924-467d-91a7-1e652e7584fa tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:13.824906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-943af632-7924-467d-91a7-1e652e7584fa tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:13.825966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-943af632-7924-467d-91a7-1e652e7584fa tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:13.826902 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-943af632-7924-467d-91a7-1e652e7584fa tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:13.828296 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-943af632-7924-467d-91a7-1e652e7584fa tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:13.829214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-943af632-7924-467d-91a7-1e652e7584fa tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:13.829997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-943af632-7924-467d-91a7-1e652e7584fa tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:14.392078 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.objects.instance [None req-21ed6d33-b8e1-4f10-a89c-f33c1647b099 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lazy-loading 'services' on Instance uuid fd812373-cfc2-4d5e-8230-2e0a72153994 {{(pid=120855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:28:14.995244 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-21ed6d33-b8e1-4f10-a89c-f33c1647b099 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/os-volume_attachments/5077b40e-6b77-4352-bc6c-316d37f92f62" status: 202 len: 0 microversion: 2.1 time: 1.387955 Aug 23 22:28:15.006823 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 244/482] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:28:13 2022] DELETE /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/os-volume_attachments/5077b40e-6b77-4352-bc6c-316d37f92f62 => generated 0 bytes in 1402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:28:15.048547 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-f918cf47-a815-4076-9a9d-cc69ce1edac4 req-6b9cdc22-1b45-412c-84ed-473cc9af2c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30f307e-cf90-4c02-ab66-f16d7bc4b427", "tag": "e9f61e27-4256-4ba2-904d-a608368e989b"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:15.156806 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-f918cf47-a815-4076-9a9d-cc69ce1edac4 req-6b9cdc22-1b45-412c-84ed-473cc9af2c02 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:15.169670 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-f918cf47-a815-4076-9a9d-cc69ce1edac4 req-6b9cdc22-1b45-412c-84ed-473cc9af2c02 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:15.172243 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-f918cf47-a815-4076-9a9d-cc69ce1edac4 req-6b9cdc22-1b45-412c-84ed-473cc9af2c02 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:15.245498 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-f918cf47-a815-4076-9a9d-cc69ce1edac4 req-6b9cdc22-1b45-412c-84ed-473cc9af2c02 service nova] Creating event network-changed:e9f61e27-4256-4ba2-904d-a608368e989b for instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 on hv-cinder-85032 Aug 23 22:28:15.275872 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-f918cf47-a815-4076-9a9d-cc69ce1edac4 req-6b9cdc22-1b45-412c-84ed-473cc9af2c02 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254103 Aug 23 22:28:15.283211 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 245/483] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:28:15.316282 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:15.333591 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:15.364252 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:15.365543 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:15.368237 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:15.370201 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:15.371397 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:15.372801 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:15.512488 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-943af632-7924-467d-91a7-1e652e7584fa tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:15.648626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-943af632-7924-467d-91a7-1e652e7584fa tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1761 microversion: 2.1 time: 1.907283 Aug 23 22:28:15.662903 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 239/484] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:13 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1761 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:15.927318 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:16.018985 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:16.031318 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:16.041482 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-afe0110d-f71c-4257-a04b-13ac91321d1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.746279 Aug 23 22:28:16.045775 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 246/485] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:15 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:17.089892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:17.115586 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:17.155928 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:17.166479 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:17.171220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:17.173699 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:17.177268 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:17.183277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:17.797923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:17.833917 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:17.852722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:17.859598 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3307c68c-2210-469d-b38c-89b4fd542fbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.777376 Aug 23 22:28:17.877776 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 240/486] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:17 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:18.924084 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:18.925468 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:18.957990 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:18.959310 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:18.960728 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:18.962215 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:18.963097 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:18.963899 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:19.384567 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:19.443321 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:19.449966 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:19.452588 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3fe8a271-56f9-458b-b40d-7dbfb6114394 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.548477 Aug 23 22:28:19.454414 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 247/487] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:18 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:20.497417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:20.498811 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:20.513847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:20.515033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:20.515977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:20.517487 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:20.518376 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:20.519115 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:20.926199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:20.942757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:20.946059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:20.947499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-24651f6a-94de-41cb-9015-080ac7811270 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.459025 Aug 23 22:28:20.948185 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 241/488] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:20 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:21.993288 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:21.994436 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:22.009035 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:22.010499 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:22.011612 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:22.014367 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:22.015610 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:22.016790 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:22.360517 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:22.368278 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:22.384761 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:22.389848 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:22.393975 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-0ab3354d-9054-4126-90b5-36f3cd638148 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.410180 Aug 23 22:28:22.398333 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 248/489] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:21 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:22.408099 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f8492079-feeb-4b30-80ce-6bec2c61cff3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:22.421993 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f8492079-feeb-4b30-80ce-6bec2c61cff3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:22.422807 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f8492079-feeb-4b30-80ce-6bec2c61cff3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:22.423463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f8492079-feeb-4b30-80ce-6bec2c61cff3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:22.471888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f8492079-feeb-4b30-80ce-6bec2c61cff3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Going to try to stop instance {{(pid=120856) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 22:28:22.544153 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-567359090", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "networks": [{"uuid": "5bddff4f-8ee4-4f70-b11a-45aed32fa202"}]}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:22.556052 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f8492079-feeb-4b30-80ce-6bec2c61cff3 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/action" status: 202 len: 0 microversion: 2.1 time: 0.155561 Aug 23 22:28:22.557421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 242/490] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:28:22 2022] POST /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:28:22.573826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cda1ac76-ace1-49fc-b35e-98e13ccef4ba tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:22.574551 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cda1ac76-ace1-49fc-b35e-98e13ccef4ba tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:22.590275 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cda1ac76-ace1-49fc-b35e-98e13ccef4ba tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:22.591391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cda1ac76-ace1-49fc-b35e-98e13ccef4ba tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:22.592134 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cda1ac76-ace1-49fc-b35e-98e13ccef4ba tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:22.593935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cda1ac76-ace1-49fc-b35e-98e13ccef4ba tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:22.594808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cda1ac76-ace1-49fc-b35e-98e13ccef4ba tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:22.595712 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cda1ac76-ace1-49fc-b35e-98e13ccef4ba tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:22.639573 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.network.neutron [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] validate_networks() for [('5bddff4f-8ee4-4f70-b11a-45aed32fa202', None, None, None, None, None)] {{(pid=120855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:28:22.839340 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-cda1ac76-ace1-49fc-b35e-98e13ccef4ba tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:22.854266 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cda1ac76-ace1-49fc-b35e-98e13ccef4ba tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.288790 Aug 23 22:28:22.854975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 243/491] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:22 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:23.311977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Flavor limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:28:23.312697 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Image limits 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:28:23.313610 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Flavor pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:28:23.314507 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Image pref 0:0:0 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:28:23.315288 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.virt.hardware [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:28:23.339721 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:23.340702 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:23.341420 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:23.342858 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:23.343711 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:23.344477 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:23.380567 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Getting quotas for project 73aca04a5685447fb698a46da1b0b8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:28:23.390266 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.quota [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Getting quotas for user 5918150a21314cf2b28bcee3072457ae and project 73aca04a5685447fb698a46da1b0b8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:28:23.413836 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Going to run 1 instances... {{(pid=120855) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:28:23.418497 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:28:23.439726 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:23.442176 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:23.455824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:23.456783 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:23.458480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:23.459842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:23.460690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:23.462911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:23.472321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:23.496780 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-463b4af4-34ce-4acc-93d3-3a1b703b0953 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960100 Aug 23 22:28:23.497834 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 249/492] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:28:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:28:23.514934 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-1cd014f3-0dca-41cf-8e88-f38ece97dda7 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:23.515639 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-1cd014f3-0dca-41cf-8e88-f38ece97dda7 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:23.594344 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-1cd014f3-0dca-41cf-8e88-f38ece97dda7 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:23.608922 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-1cd014f3-0dca-41cf-8e88-f38ece97dda7 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1218 microversion: 2.1 time: 0.098012 Aug 23 22:28:23.609965 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 250/493] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:23 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:23.893910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3f276c23-3c8a-4f80-bb2d-786552f7ee7c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:23.894917 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3f276c23-3c8a-4f80-bb2d-786552f7ee7c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:23.905028 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3f276c23-3c8a-4f80-bb2d-786552f7ee7c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:23.906292 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3f276c23-3c8a-4f80-bb2d-786552f7ee7c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:23.906939 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3f276c23-3c8a-4f80-bb2d-786552f7ee7c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:23.908071 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3f276c23-3c8a-4f80-bb2d-786552f7ee7c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:23.908577 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3f276c23-3c8a-4f80-bb2d-786552f7ee7c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:23.909034 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3f276c23-3c8a-4f80-bb2d-786552f7ee7c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:23.982230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:24.005822 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:24.008959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:24.010824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-17cb06f9-b57d-454b-a6a9-147c0e87dbd1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.578916 Aug 23 22:28:24.012229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 244/494] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:23 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:24.167225 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3f276c23-3c8a-4f80-bb2d-786552f7ee7c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:24.190514 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3f276c23-3c8a-4f80-bb2d-786552f7ee7c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.301687 Aug 23 22:28:24.205296 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 251/495] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:23 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:24.645953 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-abfa1e97-da6f-43a6-8e8c-6177a40a7def tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:24.646832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-abfa1e97-da6f-43a6-8e8c-6177a40a7def tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:24.656173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abfa1e97-da6f-43a6-8e8c-6177a40a7def tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:24.656871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abfa1e97-da6f-43a6-8e8c-6177a40a7def tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:24.657571 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abfa1e97-da6f-43a6-8e8c-6177a40a7def tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:24.658496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abfa1e97-da6f-43a6-8e8c-6177a40a7def tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:24.659048 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abfa1e97-da6f-43a6-8e8c-6177a40a7def tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:24.659701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-abfa1e97-da6f-43a6-8e8c-6177a40a7def tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:24.784046 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-abfa1e97-da6f-43a6-8e8c-6177a40a7def tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:24.808142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-abfa1e97-da6f-43a6-8e8c-6177a40a7def tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1270 microversion: 2.1 time: 0.167111 Aug 23 22:28:24.809323 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 245/496] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:24 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:25.047279 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:25.048769 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:25.071203 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:25.072249 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:25.073149 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:25.074582 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:25.075411 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:25.076173 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:25.166872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5b4a56e4-d8c6-4bc3-a84e-d4a75b54d37a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:25.171654 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5b4a56e4-d8c6-4bc3-a84e-d4a75b54d37a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:25.199332 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b4a56e4-d8c6-4bc3-a84e-d4a75b54d37a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:25.202018 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b4a56e4-d8c6-4bc3-a84e-d4a75b54d37a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:25.203337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b4a56e4-d8c6-4bc3-a84e-d4a75b54d37a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:25.204480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b4a56e4-d8c6-4bc3-a84e-d4a75b54d37a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:25.205354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b4a56e4-d8c6-4bc3-a84e-d4a75b54d37a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:25.206126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b4a56e4-d8c6-4bc3-a84e-d4a75b54d37a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:25.360814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5b4a56e4-d8c6-4bc3-a84e-d4a75b54d37a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "POST /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/action" status: 202 len: 0 microversion: 2.1 time: 0.200310 Aug 23 22:28:25.369298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 246/497] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:28:25 2022] POST /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:28:25.380384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-91d42eba-ab77-4952-b429-62e4690e2505 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:25.383578 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-91d42eba-ab77-4952-b429-62e4690e2505 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:25.396104 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d42eba-ab77-4952-b429-62e4690e2505 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:25.397357 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d42eba-ab77-4952-b429-62e4690e2505 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:25.398379 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d42eba-ab77-4952-b429-62e4690e2505 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:25.400092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d42eba-ab77-4952-b429-62e4690e2505 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:25.401144 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d42eba-ab77-4952-b429-62e4690e2505 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:25.402066 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d42eba-ab77-4952-b429-62e4690e2505 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:25.408405 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:25.431094 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:25.434627 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:25.436602 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ccfcfaff-feb6-4d79-b78f-d27ddf30e24c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.394804 Aug 23 22:28:25.439100 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 252/498] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:25 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:25.446644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a3ea6714-a7c2-4da3-9f77-8b723a5e97a4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:25.447808 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a3ea6714-a7c2-4da3-9f77-8b723a5e97a4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:25.457694 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3ea6714-a7c2-4da3-9f77-8b723a5e97a4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:25.462136 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3ea6714-a7c2-4da3-9f77-8b723a5e97a4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:25.463422 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3ea6714-a7c2-4da3-9f77-8b723a5e97a4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:25.467464 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3ea6714-a7c2-4da3-9f77-8b723a5e97a4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:25.468670 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3ea6714-a7c2-4da3-9f77-8b723a5e97a4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:25.470652 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3ea6714-a7c2-4da3-9f77-8b723a5e97a4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:25.786945 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a3ea6714-a7c2-4da3-9f77-8b723a5e97a4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:25.807891 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a3ea6714-a7c2-4da3-9f77-8b723a5e97a4 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1753 microversion: 2.1 time: 0.366815 Aug 23 22:28:25.808594 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 253/499] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:25 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1753 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:25.849606 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ec683e74-ea0d-4ac0-a175-cccfe9a50330 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:25.851406 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ec683e74-ea0d-4ac0-a175-cccfe9a50330 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:25.861781 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec683e74-ea0d-4ac0-a175-cccfe9a50330 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:25.862721 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec683e74-ea0d-4ac0-a175-cccfe9a50330 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:25.863518 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec683e74-ea0d-4ac0-a175-cccfe9a50330 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:25.864879 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec683e74-ea0d-4ac0-a175-cccfe9a50330 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:25.865808 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec683e74-ea0d-4ac0-a175-cccfe9a50330 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:25.867130 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec683e74-ea0d-4ac0-a175-cccfe9a50330 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:25.995595 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ec683e74-ea0d-4ac0-a175-cccfe9a50330 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:26.013442 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ec683e74-ea0d-4ac0-a175-cccfe9a50330 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1276 microversion: 2.1 time: 0.171243 Aug 23 22:28:26.031030 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 254/500] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:25 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:26.266526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-91d42eba-ab77-4952-b429-62e4690e2505 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:26.282041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-91d42eba-ab77-4952-b429-62e4690e2505 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.910236 Aug 23 22:28:26.283305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 247/501] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:25 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:26.484165 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:26.486142 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:26.489085 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:26.497980 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:26.498481 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:26.498910 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:26.499899 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:26.500376 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:26.502000 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:26.726638 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:26.739913 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:26.742409 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:26.743851 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-183a62f1-e90f-4059-ae9d-72489f43d5bc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.264536 Aug 23 22:28:26.744609 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 255/502] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:26 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:28:26.848508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d10e8b1a-9750-4461-a654-2c32218106c5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:26.851327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d10e8b1a-9750-4461-a654-2c32218106c5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:26.860759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d10e8b1a-9750-4461-a654-2c32218106c5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:26.861599 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d10e8b1a-9750-4461-a654-2c32218106c5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:26.862113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d10e8b1a-9750-4461-a654-2c32218106c5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:26.863241 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d10e8b1a-9750-4461-a654-2c32218106c5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:26.863953 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d10e8b1a-9750-4461-a654-2c32218106c5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:26.864539 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d10e8b1a-9750-4461-a654-2c32218106c5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:27.051805 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5f041fd5-d5a1-49b3-b64d-e7e53274a9fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:27.052833 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-5f041fd5-d5a1-49b3-b64d-e7e53274a9fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:27.065327 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f041fd5-d5a1-49b3-b64d-e7e53274a9fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:27.065848 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f041fd5-d5a1-49b3-b64d-e7e53274a9fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:27.066666 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f041fd5-d5a1-49b3-b64d-e7e53274a9fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:27.068004 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f041fd5-d5a1-49b3-b64d-e7e53274a9fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:27.068855 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f041fd5-d5a1-49b3-b64d-e7e53274a9fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:27.070328 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5f041fd5-d5a1-49b3-b64d-e7e53274a9fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:27.232772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d10e8b1a-9750-4461-a654-2c32218106c5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:27.251482 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d10e8b1a-9750-4461-a654-2c32218106c5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1753 microversion: 2.1 time: 0.408089 Aug 23 22:28:27.252494 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 248/503] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:26 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1753 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:27.317852 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a4ea40e1-7f92-40f7-8f43-3eb8b9fc5ea5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:27.318866 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a4ea40e1-7f92-40f7-8f43-3eb8b9fc5ea5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:27.326562 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a4ea40e1-7f92-40f7-8f43-3eb8b9fc5ea5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:27.327200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a4ea40e1-7f92-40f7-8f43-3eb8b9fc5ea5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:27.327903 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a4ea40e1-7f92-40f7-8f43-3eb8b9fc5ea5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:27.328751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a4ea40e1-7f92-40f7-8f43-3eb8b9fc5ea5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:27.329442 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a4ea40e1-7f92-40f7-8f43-3eb8b9fc5ea5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:27.330031 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a4ea40e1-7f92-40f7-8f43-3eb8b9fc5ea5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:27.339143 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5f041fd5-d5a1-49b3-b64d-e7e53274a9fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:27.349840 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5f041fd5-d5a1-49b3-b64d-e7e53274a9fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1318 microversion: 2.1 time: 0.305417 Aug 23 22:28:27.351341 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 256/504] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:27 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:27.536071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a4ea40e1-7f92-40f7-8f43-3eb8b9fc5ea5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:27.545658 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a4ea40e1-7f92-40f7-8f43-3eb8b9fc5ea5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.232787 Aug 23 22:28:27.546404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 249/505] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:27 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:27.787450 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:27.789246 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:27.802139 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:27.804406 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:27.805454 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:27.808188 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:27.809254 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:27.810274 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:28.067933 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:28.088960 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:28.092434 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:28.095573 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-c321bd54-24dd-415f-83eb-69d4e08943cb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.315155 Aug 23 22:28:28.097497 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 257/506] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:27 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:28.282652 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-31c3f1ca-b53f-46d0-9377-d5b51359bdac tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:28.284369 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-31c3f1ca-b53f-46d0-9377-d5b51359bdac tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:28.298231 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31c3f1ca-b53f-46d0-9377-d5b51359bdac tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:28.299093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31c3f1ca-b53f-46d0-9377-d5b51359bdac tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:28.299884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31c3f1ca-b53f-46d0-9377-d5b51359bdac tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:28.301291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31c3f1ca-b53f-46d0-9377-d5b51359bdac tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:28.302179 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31c3f1ca-b53f-46d0-9377-d5b51359bdac tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:28.303129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-31c3f1ca-b53f-46d0-9377-d5b51359bdac tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:28.381222 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a5de1afe-6fcc-4c51-b32c-307e045e8c92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:28.384322 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a5de1afe-6fcc-4c51-b32c-307e045e8c92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:28.396144 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a5de1afe-6fcc-4c51-b32c-307e045e8c92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:28.397009 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a5de1afe-6fcc-4c51-b32c-307e045e8c92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:28.398339 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a5de1afe-6fcc-4c51-b32c-307e045e8c92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:28.399622 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a5de1afe-6fcc-4c51-b32c-307e045e8c92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:28.400465 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a5de1afe-6fcc-4c51-b32c-307e045e8c92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:28.405578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a5de1afe-6fcc-4c51-b32c-307e045e8c92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:28.676473 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a5de1afe-6fcc-4c51-b32c-307e045e8c92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:28.693806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-31c3f1ca-b53f-46d0-9377-d5b51359bdac tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:28.696703 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a5de1afe-6fcc-4c51-b32c-307e045e8c92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1318 microversion: 2.1 time: 0.322826 Aug 23 22:28:28.712445 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 258/507] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:28 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:28.712445 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-30c4008d-4d3f-4005-9d1e-9c4826f38ba7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:28.712445 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-30c4008d-4d3f-4005-9d1e-9c4826f38ba7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:28.715440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-31c3f1ca-b53f-46d0-9377-d5b51359bdac tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.442751 Aug 23 22:28:28.717581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 250/508] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:28 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:28.723335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-30c4008d-4d3f-4005-9d1e-9c4826f38ba7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:28.724247 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-30c4008d-4d3f-4005-9d1e-9c4826f38ba7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:28.725095 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-30c4008d-4d3f-4005-9d1e-9c4826f38ba7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:28.726588 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-30c4008d-4d3f-4005-9d1e-9c4826f38ba7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:28.728140 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-30c4008d-4d3f-4005-9d1e-9c4826f38ba7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:28.728952 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-30c4008d-4d3f-4005-9d1e-9c4826f38ba7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:28.793166 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-7f64ba34-0469-4030-83b7-d2c5acba3686 req-78577c6a-8a65-492e-8730-4f6c6151adbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0371a0e2-f3eb-4f94-a4c2-74e8335ce12e", "tag": "c1e4982f-78f6-4b6f-a0dc-6cc910e101a8"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:28.816286 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7f64ba34-0469-4030-83b7-d2c5acba3686 req-78577c6a-8a65-492e-8730-4f6c6151adbb service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:28.817245 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7f64ba34-0469-4030-83b7-d2c5acba3686 req-78577c6a-8a65-492e-8730-4f6c6151adbb service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:28.818309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7f64ba34-0469-4030-83b7-d2c5acba3686 req-78577c6a-8a65-492e-8730-4f6c6151adbb service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:28.841445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-7f64ba34-0469-4030-83b7-d2c5acba3686 req-78577c6a-8a65-492e-8730-4f6c6151adbb service nova] Creating event network-changed:c1e4982f-78f6-4b6f-a0dc-6cc910e101a8 for instance 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e on hv-cinder-85032 Aug 23 22:28:28.851888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-7f64ba34-0469-4030-83b7-d2c5acba3686 req-78577c6a-8a65-492e-8730-4f6c6151adbb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064789 Aug 23 22:28:28.853403 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 251/509] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:28:28.992578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-30c4008d-4d3f-4005-9d1e-9c4826f38ba7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:29.009346 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-30c4008d-4d3f-4005-9d1e-9c4826f38ba7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.308135 Aug 23 22:28:29.010668 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 259/510] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:28 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:29.140013 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:29.141305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:29.153430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:29.154331 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:29.155142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:29.156450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:29.157354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:29.158140 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:29.473191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:29.492335 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:29.495802 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:29.498181 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2837e669-fe3f-43e7-832c-1a951e035f87 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.366243 Aug 23 22:28:29.499228 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 252/511] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:29 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:28:29.752992 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-981ded1a-d6b4-464a-8ef6-9b467ca39be5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:29.753807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-981ded1a-d6b4-464a-8ef6-9b467ca39be5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:29.769092 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-981ded1a-d6b4-464a-8ef6-9b467ca39be5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:29.769092 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-981ded1a-d6b4-464a-8ef6-9b467ca39be5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:29.769092 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-981ded1a-d6b4-464a-8ef6-9b467ca39be5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:29.769092 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-981ded1a-d6b4-464a-8ef6-9b467ca39be5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:29.769816 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-981ded1a-d6b4-464a-8ef6-9b467ca39be5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:29.769816 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-981ded1a-d6b4-464a-8ef6-9b467ca39be5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:29.770065 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-369430ec-7a81-46ff-ad12-aa43068b0435 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:29.775049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-369430ec-7a81-46ff-ad12-aa43068b0435 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:29.787748 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369430ec-7a81-46ff-ad12-aa43068b0435 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:29.790485 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369430ec-7a81-46ff-ad12-aa43068b0435 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:29.791829 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369430ec-7a81-46ff-ad12-aa43068b0435 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:29.793527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369430ec-7a81-46ff-ad12-aa43068b0435 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:29.794759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369430ec-7a81-46ff-ad12-aa43068b0435 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:29.795898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369430ec-7a81-46ff-ad12-aa43068b0435 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:30.080062 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-369430ec-7a81-46ff-ad12-aa43068b0435 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:30.091985 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-369430ec-7a81-46ff-ad12-aa43068b0435 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.331212 Aug 23 22:28:30.092606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 253/512] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:29 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:30.098780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6190376e-40a2-44d5-9fc6-59cc1cad6a5f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:30.099515 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6190376e-40a2-44d5-9fc6-59cc1cad6a5f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:30.111198 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6190376e-40a2-44d5-9fc6-59cc1cad6a5f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:30.112511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6190376e-40a2-44d5-9fc6-59cc1cad6a5f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:30.113582 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6190376e-40a2-44d5-9fc6-59cc1cad6a5f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:30.115466 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6190376e-40a2-44d5-9fc6-59cc1cad6a5f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:30.116624 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6190376e-40a2-44d5-9fc6-59cc1cad6a5f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:30.117727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6190376e-40a2-44d5-9fc6-59cc1cad6a5f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:30.275210 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-981ded1a-d6b4-464a-8ef6-9b467ca39be5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:30.291627 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-981ded1a-d6b4-464a-8ef6-9b467ca39be5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1318 microversion: 2.1 time: 0.543476 Aug 23 22:28:30.293127 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 260/513] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:29 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:30.345723 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6190376e-40a2-44d5-9fc6-59cc1cad6a5f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:30.358973 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6190376e-40a2-44d5-9fc6-59cc1cad6a5f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.264751 Aug 23 22:28:30.359759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 254/514] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:30 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:30.529533 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:30.530563 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:30.542785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:30.544368 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:30.544695 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:30.546036 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:30.546895 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:30.547675 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:30.720481 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:30.731016 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:30.732873 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:30.734142 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-c8a8cf36-ec51-4418-ac3c-ca778cc1f5c8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.212879 Aug 23 22:28:30.734936 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 261/515] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:30 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:31.132374 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e146c940-1dea-43ee-a63d-21c633361fea tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:31.133325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e146c940-1dea-43ee-a63d-21c633361fea tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:31.140791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e146c940-1dea-43ee-a63d-21c633361fea tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:31.141322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e146c940-1dea-43ee-a63d-21c633361fea tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:31.141764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e146c940-1dea-43ee-a63d-21c633361fea tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:31.142666 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e146c940-1dea-43ee-a63d-21c633361fea tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:31.143164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e146c940-1dea-43ee-a63d-21c633361fea tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:31.143590 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e146c940-1dea-43ee-a63d-21c633361fea tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:31.318773 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b54db334-99d9-4dbd-b1c6-050d875a3dfd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:31.320794 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-b54db334-99d9-4dbd-b1c6-050d875a3dfd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:31.332654 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b54db334-99d9-4dbd-b1c6-050d875a3dfd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:31.333435 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b54db334-99d9-4dbd-b1c6-050d875a3dfd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:31.334229 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b54db334-99d9-4dbd-b1c6-050d875a3dfd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:31.335800 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b54db334-99d9-4dbd-b1c6-050d875a3dfd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:31.336636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b54db334-99d9-4dbd-b1c6-050d875a3dfd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:31.337437 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b54db334-99d9-4dbd-b1c6-050d875a3dfd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:31.520022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e146c940-1dea-43ee-a63d-21c633361fea tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:31.536301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e146c940-1dea-43ee-a63d-21c633361fea tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.410112 Aug 23 22:28:31.553242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 255/516] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:31 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:31.554178 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-b54db334-99d9-4dbd-b1c6-050d875a3dfd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:31.554468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-61bb8783-4f56-420e-bd41-8e478f1d834c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:31.554468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-61bb8783-4f56-420e-bd41-8e478f1d834c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:31.562345 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61bb8783-4f56-420e-bd41-8e478f1d834c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:31.563224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61bb8783-4f56-420e-bd41-8e478f1d834c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:31.564011 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61bb8783-4f56-420e-bd41-8e478f1d834c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:31.565129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61bb8783-4f56-420e-bd41-8e478f1d834c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:31.565960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61bb8783-4f56-420e-bd41-8e478f1d834c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:31.566740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61bb8783-4f56-420e-bd41-8e478f1d834c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:31.573957 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-b54db334-99d9-4dbd-b1c6-050d875a3dfd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1318 microversion: 2.1 time: 0.262407 Aug 23 22:28:31.574922 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 262/517] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:31 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:31.765118 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:31.766440 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:31.780272 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:31.781356 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:31.782459 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:31.783731 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:31.784564 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:31.785359 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:31.794175 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-61bb8783-4f56-420e-bd41-8e478f1d834c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:31.812399 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-61bb8783-4f56-420e-bd41-8e478f1d834c tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.271099 Aug 23 22:28:31.813625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 256/518] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:31 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:31.993963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-a25ff1c2-317b-4b4d-88ef-08bdad33ce1a req-3ede7dee-4bb4-4762-ae41-3d04f8773e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b697da-19f2-459e-a57e-e386523e4bcf", "name": "network-vif-plugged", "status": "completed", "tag": "5867c0e1-ac00-4c87-bd75-9ca953635248"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:32.012790 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:32.015301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-a25ff1c2-317b-4b4d-88ef-08bdad33ce1a req-3ede7dee-4bb4-4762-ae41-3d04f8773e38 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:32.016393 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-a25ff1c2-317b-4b4d-88ef-08bdad33ce1a req-3ede7dee-4bb4-4762-ae41-3d04f8773e38 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:32.016998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-a25ff1c2-317b-4b4d-88ef-08bdad33ce1a req-3ede7dee-4bb4-4762-ae41-3d04f8773e38 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:32.034536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:32.038571 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:32.041461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-05f6f9ef-c6bd-4a71-ac0d-b659768adf63 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.284644 Aug 23 22:28:32.042509 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 263/519] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:31 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:28:32.042951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-a25ff1c2-317b-4b4d-88ef-08bdad33ce1a req-3ede7dee-4bb4-4762-ae41-3d04f8773e38 service nova] Creating event network-vif-plugged:5867c0e1-ac00-4c87-bd75-9ca953635248 for instance 80b697da-19f2-459e-a57e-e386523e4bcf on hv-cinder-85032 Aug 23 22:28:32.049784 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-a25ff1c2-317b-4b4d-88ef-08bdad33ce1a req-3ede7dee-4bb4-4762-ae41-3d04f8773e38 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063056 Aug 23 22:28:32.051092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 257/520] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:28:32.577793 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-d436b15c-4e91-47a6-b13c-529d51e3d749 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:32.578901 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-d436b15c-4e91-47a6-b13c-529d51e3d749 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:32.591736 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d436b15c-4e91-47a6-b13c-529d51e3d749 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:32.592612 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d436b15c-4e91-47a6-b13c-529d51e3d749 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:32.593424 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d436b15c-4e91-47a6-b13c-529d51e3d749 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:32.594821 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d436b15c-4e91-47a6-b13c-529d51e3d749 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:32.595639 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d436b15c-4e91-47a6-b13c-529d51e3d749 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:32.596449 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-d436b15c-4e91-47a6-b13c-529d51e3d749 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:32.620818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a46c1db5-ee22-49c5-85c9-87e3e6154146 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:32.623541 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a46c1db5-ee22-49c5-85c9-87e3e6154146 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:32.640164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a46c1db5-ee22-49c5-85c9-87e3e6154146 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:32.642455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a46c1db5-ee22-49c5-85c9-87e3e6154146 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:32.643171 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a46c1db5-ee22-49c5-85c9-87e3e6154146 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:32.644285 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a46c1db5-ee22-49c5-85c9-87e3e6154146 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:32.644847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a46c1db5-ee22-49c5-85c9-87e3e6154146 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:32.645360 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a46c1db5-ee22-49c5-85c9-87e3e6154146 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:32.887650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a46c1db5-ee22-49c5-85c9-87e3e6154146 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:32.889515 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-d436b15c-4e91-47a6-b13c-529d51e3d749 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:32.902643 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-d436b15c-4e91-47a6-b13c-529d51e3d749 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.332402 Aug 23 22:28:32.902948 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a46c1db5-ee22-49c5-85c9-87e3e6154146 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1318 microversion: 2.1 time: 0.300196 Aug 23 22:28:32.903237 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 264/521] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:32 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:32.908435 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-19af6431-2da5-4867-8f01-f939cac83731 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:32.909153 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-19af6431-2da5-4867-8f01-f939cac83731 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:32.910076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 258/522] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:32 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:32.919533 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19af6431-2da5-4867-8f01-f939cac83731 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:32.920371 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19af6431-2da5-4867-8f01-f939cac83731 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:32.920865 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19af6431-2da5-4867-8f01-f939cac83731 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:32.921838 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19af6431-2da5-4867-8f01-f939cac83731 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:32.922423 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19af6431-2da5-4867-8f01-f939cac83731 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:32.922928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-19af6431-2da5-4867-8f01-f939cac83731 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:33.087705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:33.088719 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:33.092188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=50 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:33.102217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:33.103122 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:33.103875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:33.105410 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:33.106241 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:33.106986 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:33.133042 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-19af6431-2da5-4867-8f01-f939cac83731 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:33.139342 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-19af6431-2da5-4867-8f01-f939cac83731 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.234628 Aug 23 22:28:33.140238 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 265/523] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:32 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:33.323060 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:33.336907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:33.340751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:33.343358 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e6187176-c6f9-424f-bf81-925cea5574e8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.263581 Aug 23 22:28:33.344425 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 259/524] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:33 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:28:33.937573 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-266f54a6-bee5-405d-89ec-a2bce99998ee tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:33.938480 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-266f54a6-bee5-405d-89ec-a2bce99998ee tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:33.940537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f4e6c25a-d502-46c0-84eb-680a31de4ef1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:33.941516 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f4e6c25a-d502-46c0-84eb-680a31de4ef1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:33.946140 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=2 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:33.948889 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell0:SELECT=8 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:33.951964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f4e6c25a-d502-46c0-84eb-680a31de4ef1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:33.952599 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f4e6c25a-d502-46c0-84eb-680a31de4ef1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:33.952989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f4e6c25a-d502-46c0-84eb-680a31de4ef1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:33.954187 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f4e6c25a-d502-46c0-84eb-680a31de4ef1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:33.955055 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f4e6c25a-d502-46c0-84eb-680a31de4ef1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:33.955649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f4e6c25a-d502-46c0-84eb-680a31de4ef1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:33.958364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-266f54a6-bee5-405d-89ec-a2bce99998ee tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:33.959206 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-266f54a6-bee5-405d-89ec-a2bce99998ee tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:33.961605 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-266f54a6-bee5-405d-89ec-a2bce99998ee tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:33.963122 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-266f54a6-bee5-405d-89ec-a2bce99998ee tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:33.963965 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-266f54a6-bee5-405d-89ec-a2bce99998ee tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:33.964972 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-266f54a6-bee5-405d-89ec-a2bce99998ee tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:34.265151 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f4e6c25a-d502-46c0-84eb-680a31de4ef1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:34.273571 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-266f54a6-bee5-405d-89ec-a2bce99998ee tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:34.287442 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f4e6c25a-d502-46c0-84eb-680a31de4ef1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.351491 Aug 23 22:28:34.289293 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 260/525] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:33 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:34.292553 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-266f54a6-bee5-405d-89ec-a2bce99998ee tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1318 microversion: 2.1 time: 0.359378 Aug 23 22:28:34.295404 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 266/526] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:33 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:34.299723 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8581f024-af27-4574-b1c1-aa8004d296ee tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:34.301335 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8581f024-af27-4574-b1c1-aa8004d296ee tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:34.311923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8581f024-af27-4574-b1c1-aa8004d296ee tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:34.312851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8581f024-af27-4574-b1c1-aa8004d296ee tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:34.313875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8581f024-af27-4574-b1c1-aa8004d296ee tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:34.315472 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8581f024-af27-4574-b1c1-aa8004d296ee tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:34.316495 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8581f024-af27-4574-b1c1-aa8004d296ee tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:34.317122 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8581f024-af27-4574-b1c1-aa8004d296ee tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:34.321210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:34.390051 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:34.391175 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:34.403522 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:34.403884 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:34.404715 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:34.406112 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:34.406974 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:34.407791 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:34.417113 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=100 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:34.513977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8581f024-af27-4574-b1c1-aa8004d296ee tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:34.525375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8581f024-af27-4574-b1c1-aa8004d296ee tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.233883 Aug 23 22:28:34.532278 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 261/527] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:34 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:34.646991 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:34.664355 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:34.667617 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:34.669892 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7a9f475b-48eb-4fce-909b-7745d09957d3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.287995 Aug 23 22:28:34.670935 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 267/528] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:34 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:28:35.329089 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-de81dacb-9f9f-42fa-8c0f-ca392b503136 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:35.329938 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-de81dacb-9f9f-42fa-8c0f-ca392b503136 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:35.331087 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-633ed0bb-71b8-4acc-99b3-96fc7b94c057 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:35.333154 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-633ed0bb-71b8-4acc-99b3-96fc7b94c057 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:35.340116 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-de81dacb-9f9f-42fa-8c0f-ca392b503136 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:35.341024 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-de81dacb-9f9f-42fa-8c0f-ca392b503136 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:35.342001 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-de81dacb-9f9f-42fa-8c0f-ca392b503136 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:35.343351 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-de81dacb-9f9f-42fa-8c0f-ca392b503136 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:35.344271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-de81dacb-9f9f-42fa-8c0f-ca392b503136 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:35.344960 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-de81dacb-9f9f-42fa-8c0f-ca392b503136 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:35.347484 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-633ed0bb-71b8-4acc-99b3-96fc7b94c057 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:35.348472 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-633ed0bb-71b8-4acc-99b3-96fc7b94c057 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:35.349314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-633ed0bb-71b8-4acc-99b3-96fc7b94c057 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:35.351796 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-633ed0bb-71b8-4acc-99b3-96fc7b94c057 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:35.352803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-633ed0bb-71b8-4acc-99b3-96fc7b94c057 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:35.353675 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-633ed0bb-71b8-4acc-99b3-96fc7b94c057 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:35.596289 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-de81dacb-9f9f-42fa-8c0f-ca392b503136 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:35.614223 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-de81dacb-9f9f-42fa-8c0f-ca392b503136 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1318 microversion: 2.1 time: 0.289149 Aug 23 22:28:35.615356 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 268/529] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:35 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:35.628165 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-886e0cf9-7a87-48ce-9aed-d6eefe5b987b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:35.630012 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-886e0cf9-7a87-48ce-9aed-d6eefe5b987b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:35.644011 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-886e0cf9-7a87-48ce-9aed-d6eefe5b987b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:35.644731 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-886e0cf9-7a87-48ce-9aed-d6eefe5b987b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:35.645477 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-886e0cf9-7a87-48ce-9aed-d6eefe5b987b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:35.646289 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-886e0cf9-7a87-48ce-9aed-d6eefe5b987b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:35.646769 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-886e0cf9-7a87-48ce-9aed-d6eefe5b987b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:35.647859 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-886e0cf9-7a87-48ce-9aed-d6eefe5b987b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:35.651706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-633ed0bb-71b8-4acc-99b3-96fc7b94c057 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:35.669355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-633ed0bb-71b8-4acc-99b3-96fc7b94c057 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.347026 Aug 23 22:28:35.670673 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 262/530] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:35 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:35.715391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:35.716864 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:35.729902 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:35.731028 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:35.731963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:35.733996 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:35.734966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:35.736202 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:35.900182 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-886e0cf9-7a87-48ce-9aed-d6eefe5b987b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:35.922333 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-886e0cf9-7a87-48ce-9aed-d6eefe5b987b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.304165 Aug 23 22:28:35.923815 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 269/531] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:35 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:36.032549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:36.055187 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:36.059196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:36.062296 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2736f815-6287-4a41-b6fd-87240c3ce470 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1807 microversion: 2.20 time: 0.356277 Aug 23 22:28:36.077765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 263/532] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:35 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1807 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:28:36.234962 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-5323cfbe-a6cc-448e-a61a-c7b13e68b415 req-adaa5930-8282-4b66-8230-b787e9839ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0371a0e2-f3eb-4f94-a4c2-74e8335ce12e", "name": "network-vif-plugged", "status": "completed", "tag": "c1e4982f-78f6-4b6f-a0dc-6cc910e101a8"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:36.252434 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-5323cfbe-a6cc-448e-a61a-c7b13e68b415 req-adaa5930-8282-4b66-8230-b787e9839ac6 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:36.253291 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-5323cfbe-a6cc-448e-a61a-c7b13e68b415 req-adaa5930-8282-4b66-8230-b787e9839ac6 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:36.254012 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-5323cfbe-a6cc-448e-a61a-c7b13e68b415 req-adaa5930-8282-4b66-8230-b787e9839ac6 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:36.278665 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-5323cfbe-a6cc-448e-a61a-c7b13e68b415 req-adaa5930-8282-4b66-8230-b787e9839ac6 service nova] Creating event network-vif-plugged:c1e4982f-78f6-4b6f-a0dc-6cc910e101a8 for instance 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e on hv-cinder-85032 Aug 23 22:28:36.290045 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-5323cfbe-a6cc-448e-a61a-c7b13e68b415 req-adaa5930-8282-4b66-8230-b787e9839ac6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059672 Aug 23 22:28:36.291180 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 270/533] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:28:36.657846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bd87d0e1-9198-4009-9659-04f53cb2850f tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:36.659493 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bd87d0e1-9198-4009-9659-04f53cb2850f tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:36.676111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd87d0e1-9198-4009-9659-04f53cb2850f tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:36.676982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd87d0e1-9198-4009-9659-04f53cb2850f tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:36.677822 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd87d0e1-9198-4009-9659-04f53cb2850f tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:36.680023 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd87d0e1-9198-4009-9659-04f53cb2850f tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:36.680834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd87d0e1-9198-4009-9659-04f53cb2850f tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:36.681634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd87d0e1-9198-4009-9659-04f53cb2850f tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:36.711011 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-f1784ee8-9486-4f9a-b5e9-468d95486848 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:36.711969 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-f1784ee8-9486-4f9a-b5e9-468d95486848 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:36.720345 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f1784ee8-9486-4f9a-b5e9-468d95486848 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:36.720580 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f1784ee8-9486-4f9a-b5e9-468d95486848 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:36.721360 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f1784ee8-9486-4f9a-b5e9-468d95486848 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:36.722107 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f1784ee8-9486-4f9a-b5e9-468d95486848 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:36.722562 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f1784ee8-9486-4f9a-b5e9-468d95486848 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:36.723006 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f1784ee8-9486-4f9a-b5e9-468d95486848 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:36.905726 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-bd87d0e1-9198-4009-9659-04f53cb2850f tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:36.917500 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bd87d0e1-9198-4009-9659-04f53cb2850f tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1318 microversion: 2.1 time: 0.267408 Aug 23 22:28:36.918549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 264/534] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:36 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:36.955819 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-f1784ee8-9486-4f9a-b5e9-468d95486848 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:36.964089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7d6f3175-725a-411d-8b86-0442b0aed459 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:36.964890 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7d6f3175-725a-411d-8b86-0442b0aed459 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:36.967722 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-f1784ee8-9486-4f9a-b5e9-468d95486848 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.262576 Aug 23 22:28:36.968323 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 271/535] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:36 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:36.975681 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7d6f3175-725a-411d-8b86-0442b0aed459 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:36.976768 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7d6f3175-725a-411d-8b86-0442b0aed459 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:36.977628 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7d6f3175-725a-411d-8b86-0442b0aed459 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:36.978977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7d6f3175-725a-411d-8b86-0442b0aed459 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:36.979845 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7d6f3175-725a-411d-8b86-0442b0aed459 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:36.980635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7d6f3175-725a-411d-8b86-0442b0aed459 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:37.109882 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:37.111077 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:37.123188 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:37.124092 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:37.124915 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:37.126264 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:37.127110 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:37.127895 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:37.197191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7d6f3175-725a-411d-8b86-0442b0aed459 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:37.206250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7d6f3175-725a-411d-8b86-0442b0aed459 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1677 microversion: 2.1 time: 0.247510 Aug 23 22:28:37.206870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 265/536] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:36 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:37.317312 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:37.328601 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:37.330451 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:37.331696 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-16ccb1b6-d257-40e5-b81a-6cc118e9073b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1794 microversion: 2.20 time: 0.231142 Aug 23 22:28:37.332363 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 272/537] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:28:37 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1794 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:28:37.951406 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b42f9687-fad6-468b-86ba-305e2b4e000b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:37.952565 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b42f9687-fad6-468b-86ba-305e2b4e000b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:37.965663 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b42f9687-fad6-468b-86ba-305e2b4e000b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:37.966566 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b42f9687-fad6-468b-86ba-305e2b4e000b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:37.967378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b42f9687-fad6-468b-86ba-305e2b4e000b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:37.968714 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b42f9687-fad6-468b-86ba-305e2b4e000b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:37.969651 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b42f9687-fad6-468b-86ba-305e2b4e000b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:37.970475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b42f9687-fad6-468b-86ba-305e2b4e000b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:38.009358 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-9282a72c-5e4d-4e76-be21-9dfc31c33300 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:38.010469 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-9282a72c-5e4d-4e76-be21-9dfc31c33300 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:38.023475 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9282a72c-5e4d-4e76-be21-9dfc31c33300 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:38.024269 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9282a72c-5e4d-4e76-be21-9dfc31c33300 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:38.025764 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9282a72c-5e4d-4e76-be21-9dfc31c33300 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:38.027706 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9282a72c-5e4d-4e76-be21-9dfc31c33300 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:38.028588 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9282a72c-5e4d-4e76-be21-9dfc31c33300 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:38.029192 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-9282a72c-5e4d-4e76-be21-9dfc31c33300 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:38.214244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b42f9687-fad6-468b-86ba-305e2b4e000b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:38.225883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b42f9687-fad6-468b-86ba-305e2b4e000b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1318 microversion: 2.1 time: 0.281357 Aug 23 22:28:38.227280 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 266/538] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:37 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:38.249534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a5c9e94c-2a41-48a8-b7b2-1755c8158519 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:38.251196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a5c9e94c-2a41-48a8-b7b2-1755c8158519 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:38.264401 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5c9e94c-2a41-48a8-b7b2-1755c8158519 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:38.266048 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5c9e94c-2a41-48a8-b7b2-1755c8158519 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:38.267188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5c9e94c-2a41-48a8-b7b2-1755c8158519 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:38.269036 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5c9e94c-2a41-48a8-b7b2-1755c8158519 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:38.270342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5c9e94c-2a41-48a8-b7b2-1755c8158519 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:38.271531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5c9e94c-2a41-48a8-b7b2-1755c8158519 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:38.306924 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-9282a72c-5e4d-4e76-be21-9dfc31c33300 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:38.319673 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-9282a72c-5e4d-4e76-be21-9dfc31c33300 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.318951 Aug 23 22:28:38.320636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 273/539] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:37 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:38.459076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a5c9e94c-2a41-48a8-b7b2-1755c8158519 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:38.468162 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a5c9e94c-2a41-48a8-b7b2-1755c8158519 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1654 microversion: 2.1 time: 0.236908 Aug 23 22:28:38.468753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 267/540] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:38 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1654 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:38.491275 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5c5ab350-a4d7-4414-8638-77769d474245 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:38.499367 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c5ab350-a4d7-4414-8638-77769d474245 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:38.499897 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c5ab350-a4d7-4414-8638-77769d474245 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:38.500339 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5c5ab350-a4d7-4414-8638-77769d474245 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:38.526592 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-5c5ab350-a4d7-4414-8638-77769d474245 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Going to try to start instance {{(pid=120855) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 22:28:38.602936 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5c5ab350-a4d7-4414-8638-77769d474245 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/action" status: 202 len: 0 microversion: 2.1 time: 0.116249 Aug 23 22:28:38.603721 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 274/541] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:28:38 2022] POST /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:28:38.617831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d48c67a7-726e-40ec-a032-3635bc08fc70 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:38.618926 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d48c67a7-726e-40ec-a032-3635bc08fc70 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:38.630337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d48c67a7-726e-40ec-a032-3635bc08fc70 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:38.632026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d48c67a7-726e-40ec-a032-3635bc08fc70 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:38.633318 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d48c67a7-726e-40ec-a032-3635bc08fc70 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:38.634210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d48c67a7-726e-40ec-a032-3635bc08fc70 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:38.634685 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d48c67a7-726e-40ec-a032-3635bc08fc70 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:38.635221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d48c67a7-726e-40ec-a032-3635bc08fc70 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:38.849824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d48c67a7-726e-40ec-a032-3635bc08fc70 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:38.864485 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d48c67a7-726e-40ec-a032-3635bc08fc70 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1663 microversion: 2.1 time: 0.254958 Aug 23 22:28:38.866150 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 268/542] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:38 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1663 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:39.272650 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3e110ddb-9739-4d90-8ac5-72882768d0f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:39.274873 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3e110ddb-9739-4d90-8ac5-72882768d0f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:39.286666 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e110ddb-9739-4d90-8ac5-72882768d0f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:39.290589 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e110ddb-9739-4d90-8ac5-72882768d0f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:39.291496 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e110ddb-9739-4d90-8ac5-72882768d0f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:39.292858 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e110ddb-9739-4d90-8ac5-72882768d0f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:39.293756 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e110ddb-9739-4d90-8ac5-72882768d0f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:39.294403 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3e110ddb-9739-4d90-8ac5-72882768d0f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:39.358520 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-805df93b-8136-4772-8ea2-963f3679bfcd tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:39.359405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-805df93b-8136-4772-8ea2-963f3679bfcd tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:39.370910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-805df93b-8136-4772-8ea2-963f3679bfcd tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:39.371597 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-805df93b-8136-4772-8ea2-963f3679bfcd tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:39.372240 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-805df93b-8136-4772-8ea2-963f3679bfcd tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:39.374010 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-805df93b-8136-4772-8ea2-963f3679bfcd tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:39.375009 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-805df93b-8136-4772-8ea2-963f3679bfcd tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:39.375931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-805df93b-8136-4772-8ea2-963f3679bfcd tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:39.530485 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3e110ddb-9739-4d90-8ac5-72882768d0f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:39.544906 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3e110ddb-9739-4d90-8ac5-72882768d0f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1504 microversion: 2.1 time: 0.281904 Aug 23 22:28:39.546025 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 275/543] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:39 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:39.831031 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-805df93b-8136-4772-8ea2-963f3679bfcd tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:39.849519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-805df93b-8136-4772-8ea2-963f3679bfcd tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.495812 Aug 23 22:28:39.852513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 269/544] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:39 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:39.906697 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-14457960-8d22-48b4-8518-e99b3f156382 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:39.907234 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-14457960-8d22-48b4-8518-e99b3f156382 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:39.921344 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-14457960-8d22-48b4-8518-e99b3f156382 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:39.922397 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-14457960-8d22-48b4-8518-e99b3f156382 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:39.923734 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-14457960-8d22-48b4-8518-e99b3f156382 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:39.925287 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-14457960-8d22-48b4-8518-e99b3f156382 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:39.926334 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-14457960-8d22-48b4-8518-e99b3f156382 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:39.927263 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-14457960-8d22-48b4-8518-e99b3f156382 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:40.195816 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-14457960-8d22-48b4-8518-e99b3f156382 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:40.211467 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-14457960-8d22-48b4-8518-e99b3f156382 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1663 microversion: 2.1 time: 0.313540 Aug 23 22:28:40.212443 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 276/545] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:39 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1663 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:40.897543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-757a0f15-117d-49c1-8671-6bdb3053a0bf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:40.898754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-757a0f15-117d-49c1-8671-6bdb3053a0bf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:40.908083 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-757a0f15-117d-49c1-8671-6bdb3053a0bf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:40.908083 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-757a0f15-117d-49c1-8671-6bdb3053a0bf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:40.908083 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-757a0f15-117d-49c1-8671-6bdb3053a0bf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:40.910752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-757a0f15-117d-49c1-8671-6bdb3053a0bf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:40.910752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-757a0f15-117d-49c1-8671-6bdb3053a0bf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:40.910752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-757a0f15-117d-49c1-8671-6bdb3053a0bf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:41.144308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-757a0f15-117d-49c1-8671-6bdb3053a0bf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:41.154632 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-757a0f15-117d-49c1-8671-6bdb3053a0bf tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.265881 Aug 23 22:28:41.155291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 270/546] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:40 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:41.246018 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-79900bd0-d389-4e94-892d-866b1b5994a8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:41.246825 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-79900bd0-d389-4e94-892d-866b1b5994a8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:41.254196 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-79900bd0-d389-4e94-892d-866b1b5994a8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:41.254718 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-79900bd0-d389-4e94-892d-866b1b5994a8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:41.255144 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-79900bd0-d389-4e94-892d-866b1b5994a8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:41.255928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-79900bd0-d389-4e94-892d-866b1b5994a8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:41.257153 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-79900bd0-d389-4e94-892d-866b1b5994a8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:41.257618 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-79900bd0-d389-4e94-892d-866b1b5994a8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:41.442493 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-79900bd0-d389-4e94-892d-866b1b5994a8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:41.453194 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-79900bd0-d389-4e94-892d-866b1b5994a8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1667 microversion: 2.1 time: 0.211435 Aug 23 22:28:41.455016 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 277/547] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:41 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1667 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:42.186760 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-833fb2c7-a1d8-464d-a13b-70ea2b741e7a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:42.187901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-833fb2c7-a1d8-464d-a13b-70ea2b741e7a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:42.201153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-833fb2c7-a1d8-464d-a13b-70ea2b741e7a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:42.202048 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-833fb2c7-a1d8-464d-a13b-70ea2b741e7a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:42.202841 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-833fb2c7-a1d8-464d-a13b-70ea2b741e7a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:42.204168 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-833fb2c7-a1d8-464d-a13b-70ea2b741e7a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:42.205039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-833fb2c7-a1d8-464d-a13b-70ea2b741e7a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:42.205870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-833fb2c7-a1d8-464d-a13b-70ea2b741e7a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:42.490666 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-833fb2c7-a1d8-464d-a13b-70ea2b741e7a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:42.509455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-833fb2c7-a1d8-464d-a13b-70ea2b741e7a tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.333963 Aug 23 22:28:42.510101 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 271/548] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:42 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:43.547469 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-4da42cbb-737e-4f3e-8b70-b800e2e509a5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:43.548347 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-4da42cbb-737e-4f3e-8b70-b800e2e509a5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:43.557739 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4da42cbb-737e-4f3e-8b70-b800e2e509a5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:43.558472 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4da42cbb-737e-4f3e-8b70-b800e2e509a5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:43.559084 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4da42cbb-737e-4f3e-8b70-b800e2e509a5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:43.559838 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4da42cbb-737e-4f3e-8b70-b800e2e509a5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:43.560346 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4da42cbb-737e-4f3e-8b70-b800e2e509a5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:43.560827 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4da42cbb-737e-4f3e-8b70-b800e2e509a5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:43.820352 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-4da42cbb-737e-4f3e-8b70-b800e2e509a5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:43.830682 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-4da42cbb-737e-4f3e-8b70-b800e2e509a5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.288248 Aug 23 22:28:43.831384 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 278/549] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:43 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:44.854690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b9838646-4033-484c-9297-7c82103910af tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:44.855742 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b9838646-4033-484c-9297-7c82103910af tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:44.863375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9838646-4033-484c-9297-7c82103910af tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:44.863942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9838646-4033-484c-9297-7c82103910af tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:44.864370 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9838646-4033-484c-9297-7c82103910af tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:44.865199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9838646-4033-484c-9297-7c82103910af tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:44.866337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9838646-4033-484c-9297-7c82103910af tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:44.866962 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9838646-4033-484c-9297-7c82103910af tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:45.075078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b9838646-4033-484c-9297-7c82103910af tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:45.086053 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b9838646-4033-484c-9297-7c82103910af tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1758 microversion: 2.1 time: 0.236176 Aug 23 22:28:45.088451 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 272/550] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:44 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1758 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:46.116853 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-375ad648-e28b-41c2-afe1-15dc65b33cc5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:46.118227 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-375ad648-e28b-41c2-afe1-15dc65b33cc5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:46.125830 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-375ad648-e28b-41c2-afe1-15dc65b33cc5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:46.126322 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-375ad648-e28b-41c2-afe1-15dc65b33cc5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:46.126779 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-375ad648-e28b-41c2-afe1-15dc65b33cc5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:46.127525 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-375ad648-e28b-41c2-afe1-15dc65b33cc5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:46.128155 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-375ad648-e28b-41c2-afe1-15dc65b33cc5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:46.128900 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-375ad648-e28b-41c2-afe1-15dc65b33cc5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:46.368742 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-375ad648-e28b-41c2-afe1-15dc65b33cc5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:46.388199 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-375ad648-e28b-41c2-afe1-15dc65b33cc5 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1761 microversion: 2.1 time: 0.274939 Aug 23 22:28:46.389373 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 279/551] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:46 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1761 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:49.348888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7b123574-c65f-4176-b45a-4fa5d76ea1c6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "661ce716-f517-4841-835e-045b1fe6367c"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:49.352042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7b123574-c65f-4176-b45a-4fa5d76ea1c6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:49.360057 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b123574-c65f-4176-b45a-4fa5d76ea1c6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:49.360896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b123574-c65f-4176-b45a-4fa5d76ea1c6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:49.361733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b123574-c65f-4176-b45a-4fa5d76ea1c6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:49.363063 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b123574-c65f-4176-b45a-4fa5d76ea1c6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:49.363937 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b123574-c65f-4176-b45a-4fa5d76ea1c6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:49.364444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b123574-c65f-4176-b45a-4fa5d76ea1c6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:49.725087 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7b123574-c65f-4176-b45a-4fa5d76ea1c6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380251 Aug 23 22:28:49.726102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 273/552] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:28:49 2022] POST /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:28:55.233993 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-18438de4-cc8f-4342-aa44-ca1f7cbf7f5d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:55.234877 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-18438de4-cc8f-4342-aa44-ca1f7cbf7f5d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:55.245741 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-18438de4-cc8f-4342-aa44-ca1f7cbf7f5d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:55.246632 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-18438de4-cc8f-4342-aa44-ca1f7cbf7f5d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:55.247436 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-18438de4-cc8f-4342-aa44-ca1f7cbf7f5d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:55.248775 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-18438de4-cc8f-4342-aa44-ca1f7cbf7f5d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:55.249652 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-18438de4-cc8f-4342-aa44-ca1f7cbf7f5d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:55.250443 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-18438de4-cc8f-4342-aa44-ca1f7cbf7f5d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:55.286080 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-18438de4-cc8f-4342-aa44-ca1f7cbf7f5d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896/ips" status: 200 len: 149 microversion: 2.1 time: 0.056925 Aug 23 22:28:55.286724 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 280/553] 10.222.0.88 () {58 vars in 1248 bytes} [Tue Aug 23 22:28:55 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896/ips => generated 149 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:28:55.306178 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ee963ed-e796-413c-9a1f-054ac0cb350a"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:55.308964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:55.315923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:55.316727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:55.317194 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:55.317912 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:55.318688 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:55.319123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:55.453854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Invalid volume: volume 0ee963ed-e796-413c-9a1f-054ac0cb350a is already attached to instances: 8a32adbd-853b-47ce-b461-e82363494a37 Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: POST /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896/os-volume_attachments HTTP/1.1 Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 74 Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:28:55.457810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {"volumeAttachment": {"volumeId": "0ee963ed-e796-413c-9a1f-054ac0cb350a"}} Aug 23 22:28:55.462312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Invalid volume: volume 0ee963ed-e796-413c-9a1f-054ac0cb350a is already attached to instances: 8a32adbd-853b-47ce-b461-e82363494a37 Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'server_id': 'a5b73e6f-743c-4663-9555-2df628611896', 'body': {'volumeAttachment': {'volumeId': '0ee963ed-e796-413c-9a1f-054ac0cb350a'}}} Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0ee963ed-e796-413c-9a1f-054ac0cb350a is already attached to instances: 8a32adbd-853b-47ce-b461-e82363494a37 Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:28:55.464127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0ee963ed-e796-413c-9a1f-054ac0cb350a is already attached to instances: 8a32adbd-853b-47ce-b461-e82363494a37 Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:28:55.466810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:28:55.469554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:28:55.469554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:28:55.469554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:28:55.469554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0ee963ed-e796-413c-9a1f-054ac0cb350a is already attached to instances: 8a32adbd-853b-47ce-b461-e82363494a37 Aug 23 22:28:55.469554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:28:55.469554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 400 to user: Invalid volume: volume 0ee963ed-e796-413c-9a1f-054ac0cb350a is already attached to instances: 8a32adbd-853b-47ce-b461-e82363494a37 {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:28:55.469554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-202af083-970a-49ec-95ce-a734265e095d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.161495 Aug 23 22:28:55.469554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 274/554] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:28:55 2022] POST /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896/os-volume_attachments => generated 174 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:28:55.481764 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bfa9cba3-2722-4aa8-86b0-b457cf07c5d6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:55.482146 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-bfa9cba3-2722-4aa8-86b0-b457cf07c5d6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:55.494796 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfa9cba3-2722-4aa8-86b0-b457cf07c5d6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:55.495650 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfa9cba3-2722-4aa8-86b0-b457cf07c5d6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:55.496418 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfa9cba3-2722-4aa8-86b0-b457cf07c5d6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:55.499409 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfa9cba3-2722-4aa8-86b0-b457cf07c5d6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:55.500471 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfa9cba3-2722-4aa8-86b0-b457cf07c5d6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:55.501292 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bfa9cba3-2722-4aa8-86b0-b457cf07c5d6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:55.554141 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-bfa9cba3-2722-4aa8-86b0-b457cf07c5d6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Going to try to terminate instance {{(pid=120855) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:28:55.701983 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-bfa9cba3-2722-4aa8-86b0-b457cf07c5d6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 204 len: 0 microversion: 2.1 time: 0.228761 Aug 23 22:28:55.703336 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 281/555] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:28:55 2022] DELETE /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:28:55.722852 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f92b2f7b-59dd-4534-8dd8-436af936176d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:55.724024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f92b2f7b-59dd-4534-8dd8-436af936176d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:55.737677 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f92b2f7b-59dd-4534-8dd8-436af936176d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:55.738553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f92b2f7b-59dd-4534-8dd8-436af936176d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:55.739341 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f92b2f7b-59dd-4534-8dd8-436af936176d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:55.740746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f92b2f7b-59dd-4534-8dd8-436af936176d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:55.741843 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f92b2f7b-59dd-4534-8dd8-436af936176d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:55.742562 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f92b2f7b-59dd-4534-8dd8-436af936176d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:55.966101 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f92b2f7b-59dd-4534-8dd8-436af936176d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:55.976006 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f92b2f7b-59dd-4534-8dd8-436af936176d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1681 microversion: 2.1 time: 0.262290 Aug 23 22:28:55.976802 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 275/556] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:55 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:57.000611 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-008ae691-6294-4e2d-b26f-69bd5040b7dd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:57.001290 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-008ae691-6294-4e2d-b26f-69bd5040b7dd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:57.003909 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:57.010428 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-008ae691-6294-4e2d-b26f-69bd5040b7dd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:57.011041 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-008ae691-6294-4e2d-b26f-69bd5040b7dd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:57.011579 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-008ae691-6294-4e2d-b26f-69bd5040b7dd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:57.012348 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-008ae691-6294-4e2d-b26f-69bd5040b7dd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:57.012838 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-008ae691-6294-4e2d-b26f-69bd5040b7dd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:57.013416 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-008ae691-6294-4e2d-b26f-69bd5040b7dd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:57.019884 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:57.216665 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-008ae691-6294-4e2d-b26f-69bd5040b7dd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:57.234561 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-008ae691-6294-4e2d-b26f-69bd5040b7dd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1681 microversion: 2.1 time: 0.238349 Aug 23 22:28:57.235557 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 282/557] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:56 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:28:58.261902 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3f2d5199-344d-49b8-991f-b59ec4c84af2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:58.262787 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3f2d5199-344d-49b8-991f-b59ec4c84af2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:58.273214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3f2d5199-344d-49b8-991f-b59ec4c84af2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:58.273687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3f2d5199-344d-49b8-991f-b59ec4c84af2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:58.274137 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3f2d5199-344d-49b8-991f-b59ec4c84af2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:58.275418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3f2d5199-344d-49b8-991f-b59ec4c84af2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:58.277246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3f2d5199-344d-49b8-991f-b59ec4c84af2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:58.277246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3f2d5199-344d-49b8-991f-b59ec4c84af2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:58.298753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:58.506664 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3f2d5199-344d-49b8-991f-b59ec4c84af2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:58.520937 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3f2d5199-344d-49b8-991f-b59ec4c84af2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1681 microversion: 2.1 time: 0.265610 Aug 23 22:28:58.522636 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 276/558] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:58 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1681 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:28:59.560958 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e73d1ade-902f-4547-b4bf-567e655f4779 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:28:59.562115 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e73d1ade-902f-4547-b4bf-567e655f4779 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:59.591287 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e73d1ade-902f-4547-b4bf-567e655f4779 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:59.592733 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e73d1ade-902f-4547-b4bf-567e655f4779 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:59.593566 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e73d1ade-902f-4547-b4bf-567e655f4779 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:59.594855 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e73d1ade-902f-4547-b4bf-567e655f4779 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:59.597199 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e73d1ade-902f-4547-b4bf-567e655f4779 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:59.600316 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e73d1ade-902f-4547-b4bf-567e655f4779 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:59.793417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cdd5eeb1-6a70-414e-a38f-0c05d2611a4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:28:59.798897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cdd5eeb1-6a70-414e-a38f-0c05d2611a4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:28:59.815106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cdd5eeb1-6a70-414e-a38f-0c05d2611a4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:59.815974 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cdd5eeb1-6a70-414e-a38f-0c05d2611a4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:59.816804 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cdd5eeb1-6a70-414e-a38f-0c05d2611a4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:59.818216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cdd5eeb1-6a70-414e-a38f-0c05d2611a4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:28:59.819289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cdd5eeb1-6a70-414e-a38f-0c05d2611a4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:28:59.820112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cdd5eeb1-6a70-414e-a38f-0c05d2611a4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:28:59.844224 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e73d1ade-902f-4547-b4bf-567e655f4779 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:28:59.862560 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e73d1ade-902f-4547-b4bf-567e655f4779 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1681 microversion: 2.1 time: 0.308625 Aug 23 22:28:59.863645 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-cdd5eeb1-6a70-414e-a38f-0c05d2611a4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lazy-loading 'flavor' on Instance uuid d1c1b881-065d-4348-9ce8-50b4cb96585c {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:28:59.871905 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 283/559] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:28:59 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1681 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:00.101781 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cdd5eeb1-6a70-414e-a38f-0c05d2611a4c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/action" status: 200 len: 32 microversion: 2.1 time: 0.315078 Aug 23 22:29:00.102797 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 277/560] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:28:59 2022] POST /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/action => generated 32 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 22:29:00.120977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7ef20680-235f-420d-85c1-61f6b0b91dc6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:00.122003 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7ef20680-235f-420d-85c1-61f6b0b91dc6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:00.136574 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ef20680-235f-420d-85c1-61f6b0b91dc6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:00.137530 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ef20680-235f-420d-85c1-61f6b0b91dc6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:00.138350 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ef20680-235f-420d-85c1-61f6b0b91dc6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:00.139685 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ef20680-235f-420d-85c1-61f6b0b91dc6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:00.140531 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ef20680-235f-420d-85c1-61f6b0b91dc6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:00.141351 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7ef20680-235f-420d-85c1-61f6b0b91dc6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:00.348760 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-7ef20680-235f-420d-85c1-61f6b0b91dc6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:00.367190 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7ef20680-235f-420d-85c1-61f6b0b91dc6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.254354 Aug 23 22:29:00.368381 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 284/561] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:00 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:00.908752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e4cbfb46-a8a0-4042-86f9-ef55bea64a5a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:00.911136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e4cbfb46-a8a0-4042-86f9-ef55bea64a5a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:00.924522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e4cbfb46-a8a0-4042-86f9-ef55bea64a5a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:00.925832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e4cbfb46-a8a0-4042-86f9-ef55bea64a5a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:00.926630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e4cbfb46-a8a0-4042-86f9-ef55bea64a5a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:00.928409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e4cbfb46-a8a0-4042-86f9-ef55bea64a5a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:00.929600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e4cbfb46-a8a0-4042-86f9-ef55bea64a5a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:00.930377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e4cbfb46-a8a0-4042-86f9-ef55bea64a5a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:01.062719 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a077f43d-9653-4bdd-9044-0c6cb3e6cb57 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d1a10cd-e917-42d1-8ac2-75218f3a1bfe", "device": "/dev/sdb"}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:01.070240 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a077f43d-9653-4bdd-9044-0c6cb3e6cb57 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:01.082457 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a077f43d-9653-4bdd-9044-0c6cb3e6cb57 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:01.083346 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a077f43d-9653-4bdd-9044-0c6cb3e6cb57 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:01.084658 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a077f43d-9653-4bdd-9044-0c6cb3e6cb57 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:01.085989 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a077f43d-9653-4bdd-9044-0c6cb3e6cb57 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:01.087072 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a077f43d-9653-4bdd-9044-0c6cb3e6cb57 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:01.087912 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a077f43d-9653-4bdd-9044-0c6cb3e6cb57 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:01.180724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e4cbfb46-a8a0-4042-86f9-ef55bea64a5a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:01.198695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e4cbfb46-a8a0-4042-86f9-ef55bea64a5a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1614 microversion: 2.1 time: 0.298801 Aug 23 22:29:01.213095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 278/562] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:00 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1614 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:01.415386 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3a1f8aa7-b224-4362-82bd-18cd65cdd5ad tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:01.416156 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3a1f8aa7-b224-4362-82bd-18cd65cdd5ad tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:01.432447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a1f8aa7-b224-4362-82bd-18cd65cdd5ad tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:01.433330 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a1f8aa7-b224-4362-82bd-18cd65cdd5ad tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:01.434081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a1f8aa7-b224-4362-82bd-18cd65cdd5ad tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:01.435599 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a1f8aa7-b224-4362-82bd-18cd65cdd5ad tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:01.436280 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a1f8aa7-b224-4362-82bd-18cd65cdd5ad tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:01.436917 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3a1f8aa7-b224-4362-82bd-18cd65cdd5ad tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:01.607809 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a077f43d-9653-4bdd-9044-0c6cb3e6cb57 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "POST /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553700 Aug 23 22:29:01.609118 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 285/563] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:29:01 2022] POST /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:01.617832 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-d9a88e27-b7f0-45b0-8e4b-6fabff08f7ce req-61490329-4bfc-4614-8334-5de18c607d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b73e6f-743c-4663-9555-2df628611896", "name": "network-vif-deleted", "tag": "2fd85c0e-2897-4f7e-bd09-e37d0339fea8"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:01.664886 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-d9a88e27-b7f0-45b0-8e4b-6fabff08f7ce req-61490329-4bfc-4614-8334-5de18c607d14 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:01.665759 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-d9a88e27-b7f0-45b0-8e4b-6fabff08f7ce req-61490329-4bfc-4614-8334-5de18c607d14 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:01.667055 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-d9a88e27-b7f0-45b0-8e4b-6fabff08f7ce req-61490329-4bfc-4614-8334-5de18c607d14 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:01.699062 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-d9a88e27-b7f0-45b0-8e4b-6fabff08f7ce req-61490329-4bfc-4614-8334-5de18c607d14 service nova] Creating event network-vif-deleted:2fd85c0e-2897-4f7e-bd09-e37d0339fea8 for instance a5b73e6f-743c-4663-9555-2df628611896 on hv-cinder-85032 Aug 23 22:29:01.708968 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-d9a88e27-b7f0-45b0-8e4b-6fabff08f7ce req-61490329-4bfc-4614-8334-5de18c607d14 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097571 Aug 23 22:29:01.709815 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 286/564] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:01.860994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3a1f8aa7-b224-4362-82bd-18cd65cdd5ad tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:01.871080 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3a1f8aa7-b224-4362-82bd-18cd65cdd5ad tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.462307 Aug 23 22:29:01.871980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 279/565] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:01 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:02.251436 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:02.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:02.267672 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:02.268916 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:02.269923 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:02.271982 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:02.273499 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:02.274488 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:02.345858 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:02.346807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:02.347805 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:02.348734 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.objects.instance [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lazy-loading 'fault' on Instance uuid a5b73e6f-743c-4663-9555-2df628611896 {{(pid=120855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:29:02.422273 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:02.436988 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-f01acadc-691b-4d5b-b2be-0fbc4b807a48 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 200 len: 1332 microversion: 2.1 time: 0.196367 Aug 23 22:29:02.438070 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 287/566] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:02 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 1332 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:02.907889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-81cbe0ca-ad98-4b4e-b7f8-5b5fc3e2c7dd tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:02.909040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-81cbe0ca-ad98-4b4e-b7f8-5b5fc3e2c7dd tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:02.921536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81cbe0ca-ad98-4b4e-b7f8-5b5fc3e2c7dd tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:02.922770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81cbe0ca-ad98-4b4e-b7f8-5b5fc3e2c7dd tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:02.923661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81cbe0ca-ad98-4b4e-b7f8-5b5fc3e2c7dd tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:02.925155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81cbe0ca-ad98-4b4e-b7f8-5b5fc3e2c7dd tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:02.926034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81cbe0ca-ad98-4b4e-b7f8-5b5fc3e2c7dd tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:02.926818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-81cbe0ca-ad98-4b4e-b7f8-5b5fc3e2c7dd tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:03.209754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-81cbe0ca-ad98-4b4e-b7f8-5b5fc3e2c7dd tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:03.225956 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-81cbe0ca-ad98-4b4e-b7f8-5b5fc3e2c7dd tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.324992 Aug 23 22:29:03.227035 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 280/567] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:02 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:03.475835 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:03.476612 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:03.487063 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:03.487591 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:03.488045 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:03.488822 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:03.489375 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:03.492058 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:03.517756 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.wsgi [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: request: GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 HTTP/1.1 Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept: application/json Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept-Encoding: identity Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Connection: close Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Length: 0 Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Type: application/json Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Host: 10.222.0.88 Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Openstack-System-Scope: None Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: User-Agent: python-urllib3/1.26.11 Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Id: None Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Name: None Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Identity-Status: Confirmed Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Is-Admin-Project: True Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Id: default Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Name: Default Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Role: member,reader Aug 23 22:29:03.520536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Roles: member,reader Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Id: default Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Name: Default Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: method: > Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: exception: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:29:03.522727 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: action_args: {'id': 'a5b73e6f-743c-4663-9555-2df628611896'} Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:29:03.528536 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:29:03.532698 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:03.536447 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. {{(pid=120855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:29:03.536447 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-cbbe463b-39a5-4319-8a26-f04600f69280 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 404 len: 111 microversion: 2.1 time: 0.052074 Aug 23 22:29:03.536447 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 288/568] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:03 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:29:03.538632 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-96753edb-104a-4045-9fb4-1565c6a9021d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '.version_select at 0x7f902c0f7d30>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:03.549259 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=44 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:03.575173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-96753edb-104a-4045-9fb4-1565c6a9021d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099048839" status: 202 len: 0 microversion: 2.1 time: 0.043795 Aug 23 22:29:03.576065 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 281/569] 10.222.0.88 () {58 vars in 1221 bytes} [Tue Aug 23 22:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099048839 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:29:04.267303 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-4cf0e876-ea37-4f53-ad80-9331652a5605 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:04.267717 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-4cf0e876-ea37-4f53-ad80-9331652a5605 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:04.276816 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4cf0e876-ea37-4f53-ad80-9331652a5605 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:04.277430 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4cf0e876-ea37-4f53-ad80-9331652a5605 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:04.277947 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4cf0e876-ea37-4f53-ad80-9331652a5605 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:04.279042 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4cf0e876-ea37-4f53-ad80-9331652a5605 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:04.279947 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4cf0e876-ea37-4f53-ad80-9331652a5605 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:04.280535 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4cf0e876-ea37-4f53-ad80-9331652a5605 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:04.450912 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-4cf0e876-ea37-4f53-ad80-9331652a5605 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:04.464493 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-4cf0e876-ea37-4f53-ad80-9331652a5605 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.205423 Aug 23 22:29:04.465121 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 289/570] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:04 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:04.648133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-399ffb39-ab71-490b-9104-ab9ad4967526 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:04.649038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-399ffb39-ab71-490b-9104-ab9ad4967526 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:04.658965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-399ffb39-ab71-490b-9104-ab9ad4967526 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:04.659791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-399ffb39-ab71-490b-9104-ab9ad4967526 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:04.660548 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-399ffb39-ab71-490b-9104-ab9ad4967526 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:04.661973 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-399ffb39-ab71-490b-9104-ab9ad4967526 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:04.662835 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-399ffb39-ab71-490b-9104-ab9ad4967526 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:04.663630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-399ffb39-ab71-490b-9104-ab9ad4967526 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:04.842619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-399ffb39-ab71-490b-9104-ab9ad4967526 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lazy-loading 'services' on Instance uuid 8a32adbd-853b-47ce-b461-e82363494a37 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:29:04.978047 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-399ffb39-ab71-490b-9104-ab9ad4967526 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments/0ee963ed-e796-413c-9a1f-054ac0cb350a" status: 202 len: 0 microversion: 2.1 time: 0.336797 Aug 23 22:29:04.978677 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 282/571] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:29:04 2022] DELETE /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments/0ee963ed-e796-413c-9a1f-054ac0cb350a => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:29:04.988332 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-7d96b3e7-23b3-46e0-8cf0-c898fca034fd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:04.991456 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-7d96b3e7-23b3-46e0-8cf0-c898fca034fd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:04.999844 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d96b3e7-23b3-46e0-8cf0-c898fca034fd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:05.000806 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d96b3e7-23b3-46e0-8cf0-c898fca034fd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:05.001343 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d96b3e7-23b3-46e0-8cf0-c898fca034fd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:05.002185 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d96b3e7-23b3-46e0-8cf0-c898fca034fd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:05.002656 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d96b3e7-23b3-46e0-8cf0-c898fca034fd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:05.003090 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-7d96b3e7-23b3-46e0-8cf0-c898fca034fd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:05.049860 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-7d96b3e7-23b3-46e0-8cf0-c898fca034fd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065693 Aug 23 22:29:05.059152 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 290/572] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:04 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:29:05.492030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a0dc8c4f-5bc2-44d0-9b5d-1d83975adb63 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:05.493496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a0dc8c4f-5bc2-44d0-9b5d-1d83975adb63 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:05.505843 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0dc8c4f-5bc2-44d0-9b5d-1d83975adb63 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:05.506737 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0dc8c4f-5bc2-44d0-9b5d-1d83975adb63 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:05.507533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0dc8c4f-5bc2-44d0-9b5d-1d83975adb63 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:05.509082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0dc8c4f-5bc2-44d0-9b5d-1d83975adb63 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:05.509816 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0dc8c4f-5bc2-44d0-9b5d-1d83975adb63 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:05.511599 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0dc8c4f-5bc2-44d0-9b5d-1d83975adb63 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:05.723497 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a0dc8c4f-5bc2-44d0-9b5d-1d83975adb63 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:05.741998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a0dc8c4f-5bc2-44d0-9b5d-1d83975adb63 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.256333 Aug 23 22:29:05.743150 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 283/573] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:05 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:06.067615 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b4a05718-1ab5-46e9-b1a3-d07c33887141 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:06.071092 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-b4a05718-1ab5-46e9-b1a3-d07c33887141 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:06.078171 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4a05718-1ab5-46e9-b1a3-d07c33887141 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:06.078667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4a05718-1ab5-46e9-b1a3-d07c33887141 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:06.079105 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4a05718-1ab5-46e9-b1a3-d07c33887141 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:06.079816 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4a05718-1ab5-46e9-b1a3-d07c33887141 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:06.080355 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4a05718-1ab5-46e9-b1a3-d07c33887141 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:06.080691 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b4a05718-1ab5-46e9-b1a3-d07c33887141 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:06.119321 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-b4a05718-1ab5-46e9-b1a3-d07c33887141 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056113 Aug 23 22:29:06.119928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 291/574] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:06 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:06.782647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e54c0618-d27e-4298-bef7-e33d000640b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:06.783335 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e54c0618-d27e-4298-bef7-e33d000640b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:06.795406 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e54c0618-d27e-4298-bef7-e33d000640b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:06.796081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e54c0618-d27e-4298-bef7-e33d000640b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:06.796521 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e54c0618-d27e-4298-bef7-e33d000640b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:06.797618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e54c0618-d27e-4298-bef7-e33d000640b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:06.798109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e54c0618-d27e-4298-bef7-e33d000640b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:06.798630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e54c0618-d27e-4298-bef7-e33d000640b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:07.012180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e54c0618-d27e-4298-bef7-e33d000640b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:07.031729 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e54c0618-d27e-4298-bef7-e33d000640b6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.255407 Aug 23 22:29:07.032960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 284/575] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:06 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:07.136984 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5d102888-25bd-4fad-b538-a7b051475fd3 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:07.140726 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-5d102888-25bd-4fad-b538-a7b051475fd3 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:07.153378 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5d102888-25bd-4fad-b538-a7b051475fd3 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:07.154173 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5d102888-25bd-4fad-b538-a7b051475fd3 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:07.154887 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5d102888-25bd-4fad-b538-a7b051475fd3 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:07.156137 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5d102888-25bd-4fad-b538-a7b051475fd3 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:07.156991 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5d102888-25bd-4fad-b538-a7b051475fd3 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:07.157785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5d102888-25bd-4fad-b538-a7b051475fd3 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:07.222186 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5d102888-25bd-4fad-b538-a7b051475fd3 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092840 Aug 23 22:29:07.223239 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 292/576] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:07 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:08.075778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bb68ac42-ef40-4d14-8fbb-9489f510843d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:08.076807 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bb68ac42-ef40-4d14-8fbb-9489f510843d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:08.089305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb68ac42-ef40-4d14-8fbb-9489f510843d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:08.090150 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb68ac42-ef40-4d14-8fbb-9489f510843d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:08.090930 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb68ac42-ef40-4d14-8fbb-9489f510843d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:08.092131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb68ac42-ef40-4d14-8fbb-9489f510843d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:08.092915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb68ac42-ef40-4d14-8fbb-9489f510843d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:08.093646 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bb68ac42-ef40-4d14-8fbb-9489f510843d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:08.240388 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-c56e2d3f-465b-4be2-9b32-d5221b5977bc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:08.243180 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-c56e2d3f-465b-4be2-9b32-d5221b5977bc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:08.251837 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c56e2d3f-465b-4be2-9b32-d5221b5977bc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:08.252490 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c56e2d3f-465b-4be2-9b32-d5221b5977bc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:08.253022 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c56e2d3f-465b-4be2-9b32-d5221b5977bc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:08.253995 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c56e2d3f-465b-4be2-9b32-d5221b5977bc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:08.254573 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c56e2d3f-465b-4be2-9b32-d5221b5977bc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:08.255220 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c56e2d3f-465b-4be2-9b32-d5221b5977bc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:08.290068 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-bb68ac42-ef40-4d14-8fbb-9489f510843d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:08.300492 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bb68ac42-ef40-4d14-8fbb-9489f510843d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.232751 Aug 23 22:29:08.301582 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 285/577] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:08 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:08.308543 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-c56e2d3f-465b-4be2-9b32-d5221b5977bc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072891 Aug 23 22:29:08.309932 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 293/578] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:08 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:29:09.330103 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-61ba9f99-d063-490a-b729-9f67b1eb16d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:09.334224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-61ba9f99-d063-490a-b729-9f67b1eb16d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:09.334497 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-4aeaed04-d996-4bd4-986f-60b9c3d193a3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:09.335241 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-4aeaed04-d996-4bd4-986f-60b9c3d193a3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:09.341864 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4aeaed04-d996-4bd4-986f-60b9c3d193a3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:09.342353 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4aeaed04-d996-4bd4-986f-60b9c3d193a3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:09.342801 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4aeaed04-d996-4bd4-986f-60b9c3d193a3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:09.343528 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4aeaed04-d996-4bd4-986f-60b9c3d193a3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:09.343992 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4aeaed04-d996-4bd4-986f-60b9c3d193a3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:09.344422 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4aeaed04-d996-4bd4-986f-60b9c3d193a3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:09.345327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61ba9f99-d063-490a-b729-9f67b1eb16d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:09.346204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61ba9f99-d063-490a-b729-9f67b1eb16d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:09.346970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61ba9f99-d063-490a-b729-9f67b1eb16d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:09.348244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61ba9f99-d063-490a-b729-9f67b1eb16d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:09.349086 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61ba9f99-d063-490a-b729-9f67b1eb16d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:09.349872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61ba9f99-d063-490a-b729-9f67b1eb16d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:09.438427 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-61ba9f99-d063-490a-b729-9f67b1eb16d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116002 Aug 23 22:29:09.439170 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 286/579] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:09 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:09.550451 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-4aeaed04-d996-4bd4-986f-60b9c3d193a3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:09.561667 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-4aeaed04-d996-4bd4-986f-60b9c3d193a3 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.231683 Aug 23 22:29:09.562423 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 294/580] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:09 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:10.458288 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a5f584b5-93f7-4d4e-8190-ec207ee0735d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:10.462710 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a5f584b5-93f7-4d4e-8190-ec207ee0735d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:10.475170 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5f584b5-93f7-4d4e-8190-ec207ee0735d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:10.475557 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5f584b5-93f7-4d4e-8190-ec207ee0735d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:10.476324 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5f584b5-93f7-4d4e-8190-ec207ee0735d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:10.480440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5f584b5-93f7-4d4e-8190-ec207ee0735d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:10.481366 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5f584b5-93f7-4d4e-8190-ec207ee0735d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:10.483161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5f584b5-93f7-4d4e-8190-ec207ee0735d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:10.549440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a5f584b5-93f7-4d4e-8190-ec207ee0735d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098988 Aug 23 22:29:10.550668 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 287/581] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:10 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:10.591153 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-4b351fe1-98a4-4e57-b6d3-d0f80087d9d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:10.592363 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-4b351fe1-98a4-4e57-b6d3-d0f80087d9d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:10.600596 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b351fe1-98a4-4e57-b6d3-d0f80087d9d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:10.601153 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b351fe1-98a4-4e57-b6d3-d0f80087d9d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:10.601612 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b351fe1-98a4-4e57-b6d3-d0f80087d9d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:10.602408 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b351fe1-98a4-4e57-b6d3-d0f80087d9d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:10.602967 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b351fe1-98a4-4e57-b6d3-d0f80087d9d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:10.603533 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-4b351fe1-98a4-4e57-b6d3-d0f80087d9d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:10.870038 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-4b351fe1-98a4-4e57-b6d3-d0f80087d9d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:10.886687 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-4b351fe1-98a4-4e57-b6d3-d0f80087d9d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.299359 Aug 23 22:29:10.888673 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 295/582] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:10 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:11.566416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a2c511a1-b745-4ce8-9d9d-96c94fe3b0d0 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:11.569107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a2c511a1-b745-4ce8-9d9d-96c94fe3b0d0 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:11.576688 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2c511a1-b745-4ce8-9d9d-96c94fe3b0d0 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:11.577303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2c511a1-b745-4ce8-9d9d-96c94fe3b0d0 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:11.577931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2c511a1-b745-4ce8-9d9d-96c94fe3b0d0 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:11.578896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2c511a1-b745-4ce8-9d9d-96c94fe3b0d0 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:11.579490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2c511a1-b745-4ce8-9d9d-96c94fe3b0d0 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:11.580043 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2c511a1-b745-4ce8-9d9d-96c94fe3b0d0 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:11.618277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a2c511a1-b745-4ce8-9d9d-96c94fe3b0d0 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056090 Aug 23 22:29:11.618927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 288/583] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:11 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:29:11.716510 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a3098ab8-f380-438a-ae7e-b447045db553 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:11.718080 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a3098ab8-f380-438a-ae7e-b447045db553 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:11.728674 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3098ab8-f380-438a-ae7e-b447045db553 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:11.729677 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3098ab8-f380-438a-ae7e-b447045db553 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:11.730446 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3098ab8-f380-438a-ae7e-b447045db553 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:11.731725 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3098ab8-f380-438a-ae7e-b447045db553 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:11.732553 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3098ab8-f380-438a-ae7e-b447045db553 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:11.733355 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a3098ab8-f380-438a-ae7e-b447045db553 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:11.769233 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a3098ab8-f380-438a-ae7e-b447045db553 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Going to try to terminate instance {{(pid=120855) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:29:11.845316 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:11.884701 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a3098ab8-f380-438a-ae7e-b447045db553 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 204 len: 0 microversion: 2.1 time: 0.175961 Aug 23 22:29:11.885676 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 296/584] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:29:11 2022] DELETE /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:29:11.899054 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0fdfde4b-1c3b-47ec-be6c-a52ae92e88f1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:11.900147 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0fdfde4b-1c3b-47ec-be6c-a52ae92e88f1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:11.907128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0fdfde4b-1c3b-47ec-be6c-a52ae92e88f1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:11.907622 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0fdfde4b-1c3b-47ec-be6c-a52ae92e88f1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:11.908060 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0fdfde4b-1c3b-47ec-be6c-a52ae92e88f1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:11.908786 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0fdfde4b-1c3b-47ec-be6c-a52ae92e88f1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:11.909379 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0fdfde4b-1c3b-47ec-be6c-a52ae92e88f1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:11.909709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0fdfde4b-1c3b-47ec-be6c-a52ae92e88f1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:11.925810 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-452ea066-acae-4ad4-8fe5-26df5168cf0a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:11.926628 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-452ea066-acae-4ad4-8fe5-26df5168cf0a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:11.934413 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-452ea066-acae-4ad4-8fe5-26df5168cf0a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:11.934923 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-452ea066-acae-4ad4-8fe5-26df5168cf0a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:11.935392 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-452ea066-acae-4ad4-8fe5-26df5168cf0a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:11.936125 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-452ea066-acae-4ad4-8fe5-26df5168cf0a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:11.936584 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-452ea066-acae-4ad4-8fe5-26df5168cf0a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:11.937096 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-452ea066-acae-4ad4-8fe5-26df5168cf0a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:12.126915 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-452ea066-acae-4ad4-8fe5-26df5168cf0a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:12.127412 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0fdfde4b-1c3b-47ec-be6c-a52ae92e88f1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:12.138928 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-452ea066-acae-4ad4-8fe5-26df5168cf0a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.218009 Aug 23 22:29:12.139977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 297/585] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:11 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:12.143097 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0fdfde4b-1c3b-47ec-be6c-a52ae92e88f1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1680 microversion: 2.1 time: 0.250927 Aug 23 22:29:12.143966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 289/586] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:11 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1680 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:13.166366 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-42131d21-12f7-4634-a47c-e87fcfbfc37a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:13.167321 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-42131d21-12f7-4634-a47c-e87fcfbfc37a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:13.180079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-545caaab-afa8-4d09-819d-cb28799701e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:13.181247 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-545caaab-afa8-4d09-819d-cb28799701e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:13.182957 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-42131d21-12f7-4634-a47c-e87fcfbfc37a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:13.183477 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-42131d21-12f7-4634-a47c-e87fcfbfc37a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:13.184317 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-42131d21-12f7-4634-a47c-e87fcfbfc37a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:13.185786 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-42131d21-12f7-4634-a47c-e87fcfbfc37a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:13.186273 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-42131d21-12f7-4634-a47c-e87fcfbfc37a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:13.186737 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-42131d21-12f7-4634-a47c-e87fcfbfc37a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:13.193527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-545caaab-afa8-4d09-819d-cb28799701e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:13.194450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-545caaab-afa8-4d09-819d-cb28799701e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:13.194951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-545caaab-afa8-4d09-819d-cb28799701e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:13.195763 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-545caaab-afa8-4d09-819d-cb28799701e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:13.196309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-545caaab-afa8-4d09-819d-cb28799701e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:13.196825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-545caaab-afa8-4d09-819d-cb28799701e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:13.405153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-545caaab-afa8-4d09-819d-cb28799701e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:13.408428 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-42131d21-12f7-4634-a47c-e87fcfbfc37a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:13.418337 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-42131d21-12f7-4634-a47c-e87fcfbfc37a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1680 microversion: 2.1 time: 0.255987 Aug 23 22:29:13.419097 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 298/587] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:13 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1680 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:13.422566 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-545caaab-afa8-4d09-819d-cb28799701e5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.249919 Aug 23 22:29:13.423966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 290/588] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:13 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:14.456171 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-f045b83c-df8e-4d10-be1f-cb5ba836ff0e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:14.457159 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-f045b83c-df8e-4d10-be1f-cb5ba836ff0e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:14.463763 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3372a521-7de0-4c38-8198-6cce09629b76 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:14.464911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3372a521-7de0-4c38-8198-6cce09629b76 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:14.467021 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f045b83c-df8e-4d10-be1f-cb5ba836ff0e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:14.467773 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f045b83c-df8e-4d10-be1f-cb5ba836ff0e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:14.468527 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f045b83c-df8e-4d10-be1f-cb5ba836ff0e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:14.469365 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f045b83c-df8e-4d10-be1f-cb5ba836ff0e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:14.470174 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f045b83c-df8e-4d10-be1f-cb5ba836ff0e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:14.470891 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-f045b83c-df8e-4d10-be1f-cb5ba836ff0e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:14.475430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3372a521-7de0-4c38-8198-6cce09629b76 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:14.476138 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3372a521-7de0-4c38-8198-6cce09629b76 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:14.476703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3372a521-7de0-4c38-8198-6cce09629b76 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:14.477697 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3372a521-7de0-4c38-8198-6cce09629b76 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:14.478395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3372a521-7de0-4c38-8198-6cce09629b76 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:14.479162 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3372a521-7de0-4c38-8198-6cce09629b76 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:14.501853 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:14.663800 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-f045b83c-df8e-4d10-be1f-cb5ba836ff0e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:14.672459 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-f045b83c-df8e-4d10-be1f-cb5ba836ff0e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1680 microversion: 2.1 time: 0.221353 Aug 23 22:29:14.673045 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 299/589] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:14 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:14.681967 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3372a521-7de0-4c38-8198-6cce09629b76 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:14.691963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3372a521-7de0-4c38-8198-6cce09629b76 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.234499 Aug 23 22:29:14.693757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 291/590] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:14 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:15.701116 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5fc76f98-2899-4b1a-81bf-310d9cd07a99 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:15.702158 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-5fc76f98-2899-4b1a-81bf-310d9cd07a99 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:15.713121 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fc76f98-2899-4b1a-81bf-310d9cd07a99 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:15.713672 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fc76f98-2899-4b1a-81bf-310d9cd07a99 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:15.714111 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fc76f98-2899-4b1a-81bf-310d9cd07a99 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:15.714881 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fc76f98-2899-4b1a-81bf-310d9cd07a99 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:15.715486 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fc76f98-2899-4b1a-81bf-310d9cd07a99 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:15.715911 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fc76f98-2899-4b1a-81bf-310d9cd07a99 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:15.718591 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-faccd201-e3f0-44bb-b776-8279708add0d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:15.719437 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-faccd201-e3f0-44bb-b776-8279708add0d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:15.732772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-faccd201-e3f0-44bb-b776-8279708add0d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:15.733691 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-faccd201-e3f0-44bb-b776-8279708add0d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:15.734493 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-faccd201-e3f0-44bb-b776-8279708add0d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:15.735813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-faccd201-e3f0-44bb-b776-8279708add0d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:15.736660 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-faccd201-e3f0-44bb-b776-8279708add0d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:15.737504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-faccd201-e3f0-44bb-b776-8279708add0d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:15.946150 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5fc76f98-2899-4b1a-81bf-310d9cd07a99 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:15.954629 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5fc76f98-2899-4b1a-81bf-310d9cd07a99 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1680 microversion: 2.1 time: 0.263537 Aug 23 22:29:15.955614 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 300/591] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:15 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:15.972477 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-faccd201-e3f0-44bb-b776-8279708add0d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:15.985168 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-faccd201-e3f0-44bb-b776-8279708add0d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.271176 Aug 23 22:29:15.985760 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 292/592] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:15 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:16.997585 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-bdc84c1c-0607-4171-a756-b528b784465a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:16.998780 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-bdc84c1c-0607-4171-a756-b528b784465a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:17.009622 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1840423f-56bc-4117-9253-4051e9447459 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:17.010733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1840423f-56bc-4117-9253-4051e9447459 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:17.011205 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bdc84c1c-0607-4171-a756-b528b784465a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:17.012079 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bdc84c1c-0607-4171-a756-b528b784465a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:17.012865 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bdc84c1c-0607-4171-a756-b528b784465a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:17.014239 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bdc84c1c-0607-4171-a756-b528b784465a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:17.015063 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bdc84c1c-0607-4171-a756-b528b784465a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:17.015862 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-bdc84c1c-0607-4171-a756-b528b784465a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:17.022368 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1840423f-56bc-4117-9253-4051e9447459 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:17.023274 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1840423f-56bc-4117-9253-4051e9447459 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:17.024075 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1840423f-56bc-4117-9253-4051e9447459 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:17.025410 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1840423f-56bc-4117-9253-4051e9447459 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:17.026243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1840423f-56bc-4117-9253-4051e9447459 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:17.026990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1840423f-56bc-4117-9253-4051e9447459 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:17.235856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1840423f-56bc-4117-9253-4051e9447459 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:17.251223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1840423f-56bc-4117-9253-4051e9447459 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.247994 Aug 23 22:29:17.252380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 293/593] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:17 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:17.259515 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-bdc84c1c-0607-4171-a756-b528b784465a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:17.272126 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-bdc84c1c-0607-4171-a756-b528b784465a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1680 microversion: 2.1 time: 0.283192 Aug 23 22:29:17.273001 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 301/594] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:16 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1680 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:18.290156 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-afb3ec8b-85e9-492a-b48a-072a679519d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:18.291035 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-afb3ec8b-85e9-492a-b48a-072a679519d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:18.297891 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-2cf93652-cc44-457b-b20e-ba732e155881 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:18.298779 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-afb3ec8b-85e9-492a-b48a-072a679519d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:18.298779 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-afb3ec8b-85e9-492a-b48a-072a679519d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:18.299117 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-2cf93652-cc44-457b-b20e-ba732e155881 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:18.299283 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-afb3ec8b-85e9-492a-b48a-072a679519d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:18.299541 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-afb3ec8b-85e9-492a-b48a-072a679519d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:18.299995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-afb3ec8b-85e9-492a-b48a-072a679519d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:18.300572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-afb3ec8b-85e9-492a-b48a-072a679519d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:18.308550 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2cf93652-cc44-457b-b20e-ba732e155881 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:18.308959 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2cf93652-cc44-457b-b20e-ba732e155881 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:18.309479 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2cf93652-cc44-457b-b20e-ba732e155881 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:18.310199 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2cf93652-cc44-457b-b20e-ba732e155881 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:18.310650 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2cf93652-cc44-457b-b20e-ba732e155881 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:18.311074 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2cf93652-cc44-457b-b20e-ba732e155881 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:18.487952 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-2cf93652-cc44-457b-b20e-ba732e155881 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:18.498876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-afb3ec8b-85e9-492a-b48a-072a679519d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:18.501187 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-2cf93652-cc44-457b-b20e-ba732e155881 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1680 microversion: 2.1 time: 0.207721 Aug 23 22:29:18.501885 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 302/595] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:18 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:18.512655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-afb3ec8b-85e9-492a-b48a-072a679519d2 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.226864 Aug 23 22:29:18.513303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 294/596] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:18 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:19.528005 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-174a03db-42f5-42fe-aeb8-b7fe6a8b32fe tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:19.529030 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-174a03db-42f5-42fe-aeb8-b7fe6a8b32fe tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:19.537010 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174a03db-42f5-42fe-aeb8-b7fe6a8b32fe tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:19.537546 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174a03db-42f5-42fe-aeb8-b7fe6a8b32fe tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:19.538039 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174a03db-42f5-42fe-aeb8-b7fe6a8b32fe tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:19.538888 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174a03db-42f5-42fe-aeb8-b7fe6a8b32fe tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:19.539378 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174a03db-42f5-42fe-aeb8-b7fe6a8b32fe tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:19.539811 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-174a03db-42f5-42fe-aeb8-b7fe6a8b32fe tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:19.552920 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ffffcc87-eea0-4322-9ad8-fa1bb5623ea7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:19.554274 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ffffcc87-eea0-4322-9ad8-fa1bb5623ea7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:19.562322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ffffcc87-eea0-4322-9ad8-fa1bb5623ea7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:19.563060 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ffffcc87-eea0-4322-9ad8-fa1bb5623ea7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:19.563564 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ffffcc87-eea0-4322-9ad8-fa1bb5623ea7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:19.564752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ffffcc87-eea0-4322-9ad8-fa1bb5623ea7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:19.565669 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ffffcc87-eea0-4322-9ad8-fa1bb5623ea7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:19.565861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ffffcc87-eea0-4322-9ad8-fa1bb5623ea7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:19.796537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ffffcc87-eea0-4322-9ad8-fa1bb5623ea7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:19.811464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ffffcc87-eea0-4322-9ad8-fa1bb5623ea7 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.265691 Aug 23 22:29:19.812576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 295/597] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:19 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:19.938242 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-174a03db-42f5-42fe-aeb8-b7fe6a8b32fe tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:19.951293 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-174a03db-42f5-42fe-aeb8-b7fe6a8b32fe tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1680 microversion: 2.1 time: 0.427393 Aug 23 22:29:19.952378 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 303/598] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:19 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1680 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:20.839588 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2201e51c-f46a-4b90-8767-288fb879f078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:20.840326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2201e51c-f46a-4b90-8767-288fb879f078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:20.849363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2201e51c-f46a-4b90-8767-288fb879f078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:20.849848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2201e51c-f46a-4b90-8767-288fb879f078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:20.850282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2201e51c-f46a-4b90-8767-288fb879f078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:20.851002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2201e51c-f46a-4b90-8767-288fb879f078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:20.851489 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2201e51c-f46a-4b90-8767-288fb879f078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:20.852661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2201e51c-f46a-4b90-8767-288fb879f078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:20.977266 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-c6c302c8-0efb-485f-afd0-1eac00b665da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:20.978079 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-c6c302c8-0efb-485f-afd0-1eac00b665da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:20.985010 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6c302c8-0efb-485f-afd0-1eac00b665da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:20.985635 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6c302c8-0efb-485f-afd0-1eac00b665da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:20.986061 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6c302c8-0efb-485f-afd0-1eac00b665da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:20.987459 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6c302c8-0efb-485f-afd0-1eac00b665da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:20.987926 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6c302c8-0efb-485f-afd0-1eac00b665da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:20.988352 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-c6c302c8-0efb-485f-afd0-1eac00b665da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:21.088261 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-c6c302c8-0efb-485f-afd0-1eac00b665da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:21.101164 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-c6c302c8-0efb-485f-afd0-1eac00b665da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1613 microversion: 2.1 time: 0.128413 Aug 23 22:29:21.102695 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 304/599] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:20 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1613 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:21.226977 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-f9dfe80c-2b3f-4a7a-b930-a1c957cfb9fd req-ba51952c-dfd6-4e28-8939-bcb264518854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a32adbd-853b-47ce-b461-e82363494a37", "name": "network-vif-deleted", "tag": "44698636-efef-43cf-a8ef-8c14ed7f08ab"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:21.245012 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-f9dfe80c-2b3f-4a7a-b930-a1c957cfb9fd req-ba51952c-dfd6-4e28-8939-bcb264518854 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:21.246050 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-f9dfe80c-2b3f-4a7a-b930-a1c957cfb9fd req-ba51952c-dfd6-4e28-8939-bcb264518854 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:21.246836 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-f9dfe80c-2b3f-4a7a-b930-a1c957cfb9fd req-ba51952c-dfd6-4e28-8939-bcb264518854 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:21.271764 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-f9dfe80c-2b3f-4a7a-b930-a1c957cfb9fd req-ba51952c-dfd6-4e28-8939-bcb264518854 service nova] Creating event network-vif-deleted:44698636-efef-43cf-a8ef-8c14ed7f08ab for instance 8a32adbd-853b-47ce-b461-e82363494a37 on hv-cinder-85032 Aug 23 22:29:21.281807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-f9dfe80c-2b3f-4a7a-b930-a1c957cfb9fd req-ba51952c-dfd6-4e28-8939-bcb264518854 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061863 Aug 23 22:29:21.282973 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 305/600] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:29:21.317034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2201e51c-f46a-4b90-8767-288fb879f078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:21.328056 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2201e51c-f46a-4b90-8767-288fb879f078 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.492802 Aug 23 22:29:21.328672 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 296/601] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:20 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:22.127576 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ba8c49d6-f9aa-4ace-bad0-d60b634c4be5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:22.128335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ba8c49d6-f9aa-4ace-bad0-d60b634c4be5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:22.136161 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ba8c49d6-f9aa-4ace-bad0-d60b634c4be5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:22.136658 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ba8c49d6-f9aa-4ace-bad0-d60b634c4be5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:22.137205 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ba8c49d6-f9aa-4ace-bad0-d60b634c4be5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:22.137936 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ba8c49d6-f9aa-4ace-bad0-d60b634c4be5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:22.138395 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ba8c49d6-f9aa-4ace-bad0-d60b634c4be5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:22.138822 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ba8c49d6-f9aa-4ace-bad0-d60b634c4be5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:22.216926 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ba8c49d6-f9aa-4ace-bad0-d60b634c4be5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:22.230548 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ba8c49d6-f9aa-4ace-bad0-d60b634c4be5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1613 microversion: 2.1 time: 0.108256 Aug 23 22:29:22.231384 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 306/602] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:22 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1613 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:22.353860 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c811ba57-4cd4-4984-a31a-7c70bcb27ac6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:22.354843 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c811ba57-4cd4-4984-a31a-7c70bcb27ac6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:22.363252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c811ba57-4cd4-4984-a31a-7c70bcb27ac6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:22.363835 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c811ba57-4cd4-4984-a31a-7c70bcb27ac6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:22.364337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c811ba57-4cd4-4984-a31a-7c70bcb27ac6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:22.365767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c811ba57-4cd4-4984-a31a-7c70bcb27ac6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:22.366505 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c811ba57-4cd4-4984-a31a-7c70bcb27ac6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:22.367048 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c811ba57-4cd4-4984-a31a-7c70bcb27ac6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:22.607091 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c811ba57-4cd4-4984-a31a-7c70bcb27ac6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:22.618844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c811ba57-4cd4-4984-a31a-7c70bcb27ac6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.269936 Aug 23 22:29:22.619613 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 297/603] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:22 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:23.261098 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ffa59f64-c15a-40bf-b6a6-a7d7572479f7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:23.261807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ffa59f64-c15a-40bf-b6a6-a7d7572479f7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:23.268511 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ffa59f64-c15a-40bf-b6a6-a7d7572479f7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:23.269127 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ffa59f64-c15a-40bf-b6a6-a7d7572479f7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:23.269566 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ffa59f64-c15a-40bf-b6a6-a7d7572479f7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:23.270356 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ffa59f64-c15a-40bf-b6a6-a7d7572479f7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:23.270814 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ffa59f64-c15a-40bf-b6a6-a7d7572479f7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:23.271255 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ffa59f64-c15a-40bf-b6a6-a7d7572479f7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:23.356232 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ffa59f64-c15a-40bf-b6a6-a7d7572479f7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:23.372144 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ffa59f64-c15a-40bf-b6a6-a7d7572479f7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1613 microversion: 2.1 time: 0.116077 Aug 23 22:29:23.373168 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 307/604] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:23 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1613 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:23.647527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5ae4921b-8b61-4b9b-9fee-5151904e8dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:23.648635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5ae4921b-8b61-4b9b-9fee-5151904e8dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:23.657166 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ae4921b-8b61-4b9b-9fee-5151904e8dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:23.657805 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ae4921b-8b61-4b9b-9fee-5151904e8dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:23.658334 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ae4921b-8b61-4b9b-9fee-5151904e8dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:23.659161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ae4921b-8b61-4b9b-9fee-5151904e8dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:23.659758 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ae4921b-8b61-4b9b-9fee-5151904e8dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:23.660270 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ae4921b-8b61-4b9b-9fee-5151904e8dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:23.953113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5ae4921b-8b61-4b9b-9fee-5151904e8dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:23.968061 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5ae4921b-8b61-4b9b-9fee-5151904e8dd8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.328146 Aug 23 22:29:23.969194 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 298/605] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:23 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:24.413561 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:24.414818 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:24.427674 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:24.428991 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:24.429916 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:24.431251 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:24.432683 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:24.434255 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:24.502424 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:24.503391 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:24.504362 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:24.505568 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.objects.instance [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lazy-loading 'fault' on Instance uuid 8a32adbd-853b-47ce-b461-e82363494a37 {{(pid=120855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:29:24.605793 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:24.620017 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a68dc850-cadb-4605-a4a3-a4368479d602 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 200 len: 1331 microversion: 2.1 time: 0.215002 Aug 23 22:29:24.621408 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 308/606] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:24 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 1331 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:24.992783 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1e7d3d0a-49ef-42e7-8b0a-cbc88d324df6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:24.993940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1e7d3d0a-49ef-42e7-8b0a-cbc88d324df6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:25.002592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1e7d3d0a-49ef-42e7-8b0a-cbc88d324df6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:25.003090 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1e7d3d0a-49ef-42e7-8b0a-cbc88d324df6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:25.003585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1e7d3d0a-49ef-42e7-8b0a-cbc88d324df6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:25.007284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1e7d3d0a-49ef-42e7-8b0a-cbc88d324df6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:25.008043 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1e7d3d0a-49ef-42e7-8b0a-cbc88d324df6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:25.008507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1e7d3d0a-49ef-42e7-8b0a-cbc88d324df6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:25.212880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1e7d3d0a-49ef-42e7-8b0a-cbc88d324df6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:25.228637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1e7d3d0a-49ef-42e7-8b0a-cbc88d324df6 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.240651 Aug 23 22:29:25.229621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 299/607] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:24 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:25.657850 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:25.659217 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:25.675861 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:25.677463 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:25.678282 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:25.680055 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:25.681029 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:25.681749 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:25.714377 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.wsgi [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: request: GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 HTTP/1.1 Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept: application/json Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept-Encoding: identity Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Connection: close Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Length: 0 Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Type: application/json Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Host: 10.222.0.88 Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Openstack-System-Scope: None Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: User-Agent: python-urllib3/1.26.11 Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Id: None Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Name: None Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Identity-Status: Confirmed Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Is-Admin-Project: True Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Id: default Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Name: Default Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Role: member,reader Aug 23 22:29:25.717271 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Roles: member,reader Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Id: default Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Name: Default Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: method: > Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: exception: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:29:25.720138 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: action_args: {'id': '8a32adbd-853b-47ce-b461-e82363494a37'} Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:29:25.721785 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:29:25.725195 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:25.728205 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. {{(pid=120855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:29:25.728205 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-56967d18-9231-4066-8e96-c8fab8da8231 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 404 len: 111 microversion: 2.1 time: 0.072393 Aug 23 22:29:25.728205 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 309/608] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:25 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:29:25.736093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7d0474a0-913f-4dae-9795-60672f251516 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '.version_select at 0x7f902c1d48b0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:25.772837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7d0474a0-913f-4dae-9795-60672f251516 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-928307855" status: 202 len: 0 microversion: 2.1 time: 0.043476 Aug 23 22:29:25.773747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 300/609] 10.222.0.88 () {58 vars in 1218 bytes} [Tue Aug 23 22:29:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-928307855 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:29:26.267081 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a1d896e8-6c60-41c0-b9af-55e65b242f10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:26.268517 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a1d896e8-6c60-41c0-b9af-55e65b242f10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:26.282296 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1d896e8-6c60-41c0-b9af-55e65b242f10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:26.283142 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1d896e8-6c60-41c0-b9af-55e65b242f10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:26.283933 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1d896e8-6c60-41c0-b9af-55e65b242f10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:26.285301 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1d896e8-6c60-41c0-b9af-55e65b242f10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:26.286850 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1d896e8-6c60-41c0-b9af-55e65b242f10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:26.287643 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a1d896e8-6c60-41c0-b9af-55e65b242f10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:26.576961 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a1d896e8-6c60-41c0-b9af-55e65b242f10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:26.591475 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a1d896e8-6c60-41c0-b9af-55e65b242f10 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.331128 Aug 23 22:29:26.606205 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 310/610] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:26 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:26.905143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fb987317-b502-4f9b-80ec-9fb20db92bc1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: .version_select at 0x7f901fed20d0>, body: {"keypair": {"name": "tempest-keypair-1451863157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0T7X1uuL4ydVtWodqjHxaIV90jr01Qfg4wPxCHeH/yiGFvnB7VmaB/Jfef2xhWdMDM0gnjVGWOlq2h+wMmPGuky6TpXs8gnVDn7rm2vJRJCXgUfWpYDtAgJxMbzI1VWQ=="}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:26.927471 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-fb987317-b502-4f9b-80ec-9fb20db92bc1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for project c0fc1c15f821495e9883814ffc7aed78. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:29:26.932876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-fb987317-b502-4f9b-80ec-9fb20db92bc1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for user 1db1a9a77be6452991ec4f99af814e7a and project c0fc1c15f821495e9883814ffc7aed78. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:29:26.962800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fb987317-b502-4f9b-80ec-9fb20db92bc1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063454 Aug 23 22:29:26.963703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 301/611] 10.222.0.88 () {60 vars in 1159 bytes} [Tue Aug 23 22:29:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:27.625144 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-5fdc3d83-90da-459f-9fbc-e19e3e6aa1ab tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:27.626222 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-5fdc3d83-90da-459f-9fbc-e19e3e6aa1ab tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:27.630847 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:27.638869 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fdc3d83-90da-459f-9fbc-e19e3e6aa1ab tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:27.639578 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fdc3d83-90da-459f-9fbc-e19e3e6aa1ab tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:27.640243 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fdc3d83-90da-459f-9fbc-e19e3e6aa1ab tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:27.641193 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fdc3d83-90da-459f-9fbc-e19e3e6aa1ab tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:27.641676 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fdc3d83-90da-459f-9fbc-e19e3e6aa1ab tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:27.642207 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-5fdc3d83-90da-459f-9fbc-e19e3e6aa1ab tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:27.711167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-088479b8-fb43-4a4a-abd0-f9734878040a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:27.712031 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-088479b8-fb43-4a4a-abd0-f9734878040a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:27.723922 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-088479b8-fb43-4a4a-abd0-f9734878040a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:27.728030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-088479b8-fb43-4a4a-abd0-f9734878040a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:27.728890 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-088479b8-fb43-4a4a-abd0-f9734878040a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:27.730284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-088479b8-fb43-4a4a-abd0-f9734878040a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:27.731540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-088479b8-fb43-4a4a-abd0-f9734878040a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:27.732328 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-088479b8-fb43-4a4a-abd0-f9734878040a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:27.865849 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-088479b8-fb43-4a4a-abd0-f9734878040a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lazy-loading 'services' on Instance uuid 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:29:27.934684 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-5fdc3d83-90da-459f-9fbc-e19e3e6aa1ab tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:27.956309 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-5fdc3d83-90da-459f-9fbc-e19e3e6aa1ab tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1738 microversion: 2.1 time: 0.338821 Aug 23 22:29:27.960647 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 311/612] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:27 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1738 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:27.995421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-088479b8-fb43-4a4a-abd0-f9734878040a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e/os-volume_attachments/7d1a10cd-e917-42d1-8ac2-75218f3a1bfe" status: 202 len: 0 microversion: 2.1 time: 0.292517 Aug 23 22:29:27.996527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 302/613] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:29:27 2022] DELETE /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e/os-volume_attachments/7d1a10cd-e917-42d1-8ac2-75218f3a1bfe => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:29:28.990007 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3bb2c5af-62d8-43e2-8c42-327cb2cc9b0f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:28.991443 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3bb2c5af-62d8-43e2-8c42-327cb2cc9b0f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:28.998536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1589941437", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c01e5e5-25ba-44de-af70-328d6d292257"}], "security_groups": [{"name": "tempest-securitygroup--1411827561"}], "key_name": "tempest-keypair-1451863157", "user_data": "}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:29.007160 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5af-62d8-43e2-8c42-327cb2cc9b0f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:29.007160 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5af-62d8-43e2-8c42-327cb2cc9b0f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:29.007160 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5af-62d8-43e2-8c42-327cb2cc9b0f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:29.007846 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5af-62d8-43e2-8c42-327cb2cc9b0f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:29.008687 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5af-62d8-43e2-8c42-327cb2cc9b0f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:29.009489 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5af-62d8-43e2-8c42-327cb2cc9b0f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:29.163587 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] validate_networks() for [('4c01e5e5-25ba-44de-af70-328d6d292257', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:29:29.269522 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3bb2c5af-62d8-43e2-8c42-327cb2cc9b0f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:29.288788 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3bb2c5af-62d8-43e2-8c42-327cb2cc9b0f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1718 microversion: 2.1 time: 0.306044 Aug 23 22:29:29.292110 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 312/614] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:28 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1718 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:29.512054 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:29.512846 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:29.523304 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:29.524595 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:29.525340 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:29.526518 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:29.527264 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:29.527958 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:29.635963 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.wsgi [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] HTTP exception thrown: Cannot 'detach_volume' instance d1c1b881-065d-4348-9ce8-50b4cb96585c while it is in vm_state rescued Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Request method failure captured: Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: request: DELETE /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments/661ce716-f517-4841-835e-045b1fe6367c HTTP/1.1 Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept: application/json Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Accept-Encoding: identity Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Connection: close Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Length: 0 Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Content-Type: application/json Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Host: 10.222.0.88 Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Openstack-System-Scope: None Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: User-Agent: python-urllib3/1.26.11 Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Auth-Token: gAAAAABjBVOv13_MU_50s_aHvDIST8LDnTZeNLrXoKO_9tRpymYOQxPByczIdikrorzz5bnQJNXBXY2DsLSgLVa6dVPKD_ZD2k345A6vw_H8htZmqauzwSRk2seRexlxlvlsqvtICY93c2IqIF6AlW97HMPeU9BZNrOrD_PqMIc0CmBjXZp0CDg Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Id: None Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Domain-Name: None Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Identity-Status: Confirmed Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Is-Admin-Project: True Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Id: default Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Domain-Name: Default Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Id: 1dfc84dc05d542d987194096f3b7e51a Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Role: member,reader Aug 23 22:29:29.639766 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Roles: member,reader Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1dfc84dc05d542d987194096f3b7e51a"}]}] Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Id: 1dfc84dc05d542d987194096f3b7e51a Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User: tempest-ServerRescueNegativeTestJSON-146746916-project Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Id: default Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Domain-Name: Default Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Id: 78b05a538ce0466ea8b3e27a0a6fc162 Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: X-User-Name: tempest-ServerRescueNegativeTestJSON-146746916-project Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: method: > Aug 23 22:29:29.644644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: exception: Cannot 'detach_volume' instance d1c1b881-065d-4348-9ce8-50b4cb96585c while it is in vm_state rescued Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: action_args: {'server_id': 'd1c1b881-065d-4348-9ce8-50b4cb96585c', 'id': '661ce716-f517-4841-835e-045b1fe6367c'} Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1c1b881-065d-4348-9ce8-50b4cb96585c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:29:29.646329 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d1c1b881-065d-4348-9ce8-50b4cb96585c while it is in vm_state rescued Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d1c1b881-065d-4348-9ce8-50b4cb96585c while it is in vm_state rescued Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: ERROR nova.api.openstack.wsgi Aug 23 22:29:29.649461 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Returning 409 to user: Cannot 'detach_volume' instance d1c1b881-065d-4348-9ce8-50b4cb96585c while it is in vm_state rescued {{(pid=120855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:29:29.651438 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-2499c116-cf11-47a6-aca6-d304f9dc8191 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments/661ce716-f517-4841-835e-045b1fe6367c" status: 409 len: 152 microversion: 2.1 time: 0.138631 Aug 23 22:29:29.651438 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 313/615] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:29:29 2022] DELETE /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments/661ce716-f517-4841-835e-045b1fe6367c => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 23 22:29:29.657147 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a258ea0f-cc47-4d93-8aca-69cce3295bce tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:29.658097 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a258ea0f-cc47-4d93-8aca-69cce3295bce tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:29.668692 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a258ea0f-cc47-4d93-8aca-69cce3295bce tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:29.669322 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a258ea0f-cc47-4d93-8aca-69cce3295bce tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:29.669768 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a258ea0f-cc47-4d93-8aca-69cce3295bce tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:29.670627 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a258ea0f-cc47-4d93-8aca-69cce3295bce tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:29.671286 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a258ea0f-cc47-4d93-8aca-69cce3295bce tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:29.671807 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a258ea0f-cc47-4d93-8aca-69cce3295bce tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:29.695040 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG dbcounter [-] [120855] Writing DB stats nova_cell1:SELECT=100 {{(pid=120855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:29.792472 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a258ea0f-cc47-4d93-8aca-69cce3295bce tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "POST /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/action" status: 202 len: 0 microversion: 2.1 time: 0.140924 Aug 23 22:29:29.793962 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 314/616] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:29:29 2022] POST /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:29:29.809135 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-132ac0ce-1635-4184-99e0-57c35b065852 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:29.810473 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-132ac0ce-1635-4184-99e0-57c35b065852 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:29.824147 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ac0ce-1635-4184-99e0-57c35b065852 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:29.825100 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ac0ce-1635-4184-99e0-57c35b065852 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:29.825840 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ac0ce-1635-4184-99e0-57c35b065852 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:29.826953 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ac0ce-1635-4184-99e0-57c35b065852 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:29.827670 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ac0ce-1635-4184-99e0-57c35b065852 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:29.828376 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-132ac0ce-1635-4184-99e0-57c35b065852 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:29.881415 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:29:29.882351 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:29:29.883074 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:29:29.883631 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:29:29.883888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:29:29.895116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:29.896506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:29.897014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:29.897988 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:29.898454 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:29.898882 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:29.927514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for project c0fc1c15f821495e9883814ffc7aed78. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:29:29.934318 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for user 1db1a9a77be6452991ec4f99af814e7a and project c0fc1c15f821495e9883814ffc7aed78. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:29:29.951956 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:29:29.955071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:29:30.018444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b0357abe-4cff-4da0-af9c-f5ba454648eb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.024921 Aug 23 22:29:30.021934 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 303/617] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:29:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:29:30.046175 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-45d70401-91cc-4ea0-84f6-98753d769b41 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:30.046706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-45d70401-91cc-4ea0-84f6-98753d769b41 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:30.085560 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-132ac0ce-1635-4184-99e0-57c35b065852 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:30.117640 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-132ac0ce-1635-4184-99e0-57c35b065852 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1726 microversion: 2.1 time: 0.313238 Aug 23 22:29:30.118701 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 315/618] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:29 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1726 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:30.162185 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-45d70401-91cc-4ea0-84f6-98753d769b41 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:30.173161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-45d70401-91cc-4ea0-84f6-98753d769b41 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1242 microversion: 2.1 time: 0.139450 Aug 23 22:29:30.174492 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 304/619] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:30 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:30.376821 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-699534e2-3786-419d-ad7d-5fc4272fd9a2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:30.377824 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-699534e2-3786-419d-ad7d-5fc4272fd9a2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:30.387643 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-699534e2-3786-419d-ad7d-5fc4272fd9a2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:30.388463 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-699534e2-3786-419d-ad7d-5fc4272fd9a2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:30.389209 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-699534e2-3786-419d-ad7d-5fc4272fd9a2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:30.390152 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-699534e2-3786-419d-ad7d-5fc4272fd9a2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:30.390832 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-699534e2-3786-419d-ad7d-5fc4272fd9a2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:30.391390 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-699534e2-3786-419d-ad7d-5fc4272fd9a2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:30.476784 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-699534e2-3786-419d-ad7d-5fc4272fd9a2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Going to try to terminate instance {{(pid=120855) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:29:30.625591 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-699534e2-3786-419d-ad7d-5fc4272fd9a2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 204 len: 0 microversion: 2.1 time: 0.254203 Aug 23 22:29:30.626679 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 316/620] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:29:30 2022] DELETE /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:29:30.641753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4f202237-8897-4b34-a148-a443de52c821 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:30.643094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4f202237-8897-4b34-a148-a443de52c821 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:30.652244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f202237-8897-4b34-a148-a443de52c821 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:30.652988 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f202237-8897-4b34-a148-a443de52c821 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:30.653653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f202237-8897-4b34-a148-a443de52c821 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:30.654424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f202237-8897-4b34-a148-a443de52c821 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:30.655066 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f202237-8897-4b34-a148-a443de52c821 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:30.655489 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f202237-8897-4b34-a148-a443de52c821 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:30.852107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4f202237-8897-4b34-a148-a443de52c821 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:30.860559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4f202237-8897-4b34-a148-a443de52c821 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1510 microversion: 2.1 time: 0.225912 Aug 23 22:29:30.861186 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 305/621] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:30 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:31.141951 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-889fd080-c730-461f-bcfe-75dc831d535e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:31.142605 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-889fd080-c730-461f-bcfe-75dc831d535e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:31.151486 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-889fd080-c730-461f-bcfe-75dc831d535e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:31.152040 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-889fd080-c730-461f-bcfe-75dc831d535e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:31.152520 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-889fd080-c730-461f-bcfe-75dc831d535e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:31.153449 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-889fd080-c730-461f-bcfe-75dc831d535e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:31.153944 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-889fd080-c730-461f-bcfe-75dc831d535e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:31.154411 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-889fd080-c730-461f-bcfe-75dc831d535e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:31.200446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c080f110-2a08-4619-95d5-ccdbe8700d62 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:31.201325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c080f110-2a08-4619-95d5-ccdbe8700d62 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:31.209478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c080f110-2a08-4619-95d5-ccdbe8700d62 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:31.210167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c080f110-2a08-4619-95d5-ccdbe8700d62 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:31.210605 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c080f110-2a08-4619-95d5-ccdbe8700d62 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:31.211326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c080f110-2a08-4619-95d5-ccdbe8700d62 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:31.211789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c080f110-2a08-4619-95d5-ccdbe8700d62 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:31.212214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c080f110-2a08-4619-95d5-ccdbe8700d62 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:31.303400 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c080f110-2a08-4619-95d5-ccdbe8700d62 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:31.318193 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c080f110-2a08-4619-95d5-ccdbe8700d62 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1246 microversion: 2.1 time: 0.121303 Aug 23 22:29:31.319173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 306/622] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:31 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1246 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:31.322880 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-889fd080-c730-461f-bcfe-75dc831d535e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:31.339557 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-889fd080-c730-461f-bcfe-75dc831d535e tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1726 microversion: 2.1 time: 0.201822 Aug 23 22:29:31.340702 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 317/623] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:31 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:31.889111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9a42819b-5d1d-437d-84a6-d1b15147a34b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:31.890232 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9a42819b-5d1d-437d-84a6-d1b15147a34b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:31.901504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a42819b-5d1d-437d-84a6-d1b15147a34b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:31.902316 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a42819b-5d1d-437d-84a6-d1b15147a34b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:31.903059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a42819b-5d1d-437d-84a6-d1b15147a34b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:31.904328 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a42819b-5d1d-437d-84a6-d1b15147a34b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:31.905042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a42819b-5d1d-437d-84a6-d1b15147a34b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:31.905807 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a42819b-5d1d-437d-84a6-d1b15147a34b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:32.091306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9a42819b-5d1d-437d-84a6-d1b15147a34b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:32.106851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9a42819b-5d1d-437d-84a6-d1b15147a34b tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1510 microversion: 2.1 time: 0.224510 Aug 23 22:29:32.107959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 307/624] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:31 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:32.354148 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a0d06039-29c9-4809-900c-5b4702773899 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:32.354714 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a0d06039-29c9-4809-900c-5b4702773899 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:32.362332 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b9e91ecb-6ecf-4abe-98a3-d9e032e01ea8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:32.363384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b9e91ecb-6ecf-4abe-98a3-d9e032e01ea8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:32.363558 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0d06039-29c9-4809-900c-5b4702773899 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:32.364814 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0d06039-29c9-4809-900c-5b4702773899 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:32.365366 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0d06039-29c9-4809-900c-5b4702773899 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:32.366253 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0d06039-29c9-4809-900c-5b4702773899 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:32.366978 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0d06039-29c9-4809-900c-5b4702773899 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:32.367334 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a0d06039-29c9-4809-900c-5b4702773899 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:32.371304 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9e91ecb-6ecf-4abe-98a3-d9e032e01ea8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:32.371789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9e91ecb-6ecf-4abe-98a3-d9e032e01ea8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:32.372218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9e91ecb-6ecf-4abe-98a3-d9e032e01ea8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:32.372951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9e91ecb-6ecf-4abe-98a3-d9e032e01ea8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:32.373459 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9e91ecb-6ecf-4abe-98a3-d9e032e01ea8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:32.373855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9e91ecb-6ecf-4abe-98a3-d9e032e01ea8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:32.450956 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a0d06039-29c9-4809-900c-5b4702773899 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:32.467204 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a0d06039-29c9-4809-900c-5b4702773899 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1246 microversion: 2.1 time: 0.117012 Aug 23 22:29:32.468907 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 318/625] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:32 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1246 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:32.582268 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b9e91ecb-6ecf-4abe-98a3-d9e032e01ea8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:32.595026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b9e91ecb-6ecf-4abe-98a3-d9e032e01ea8 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1726 microversion: 2.1 time: 0.236699 Aug 23 22:29:32.596190 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 308/626] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:32 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:33.128793 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-a377c99c-63de-4e7b-b8e7-888cc33fafe1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:33.129379 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-a377c99c-63de-4e7b-b8e7-888cc33fafe1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:33.136833 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a377c99c-63de-4e7b-b8e7-888cc33fafe1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:33.137523 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a377c99c-63de-4e7b-b8e7-888cc33fafe1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:33.138196 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a377c99c-63de-4e7b-b8e7-888cc33fafe1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:33.139217 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a377c99c-63de-4e7b-b8e7-888cc33fafe1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:33.139781 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a377c99c-63de-4e7b-b8e7-888cc33fafe1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:33.140231 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-a377c99c-63de-4e7b-b8e7-888cc33fafe1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:33.309400 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-a377c99c-63de-4e7b-b8e7-888cc33fafe1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:33.318740 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-a377c99c-63de-4e7b-b8e7-888cc33fafe1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1510 microversion: 2.1 time: 0.194199 Aug 23 22:29:33.319439 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 319/627] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:33 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:33.495352 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e00519c2-d19a-48f2-877b-76aaa10575a6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:33.496033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e00519c2-d19a-48f2-877b-76aaa10575a6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:33.507593 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e00519c2-d19a-48f2-877b-76aaa10575a6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:33.508248 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e00519c2-d19a-48f2-877b-76aaa10575a6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:33.508782 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e00519c2-d19a-48f2-877b-76aaa10575a6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:33.509688 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e00519c2-d19a-48f2-877b-76aaa10575a6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:33.510261 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e00519c2-d19a-48f2-877b-76aaa10575a6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:33.510813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e00519c2-d19a-48f2-877b-76aaa10575a6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:33.596161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e00519c2-d19a-48f2-877b-76aaa10575a6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:33.605319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e00519c2-d19a-48f2-877b-76aaa10575a6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1238 microversion: 2.1 time: 0.115858 Aug 23 22:29:33.605919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 309/628] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:33 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1238 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:33.624245 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-3804a04c-cb65-40e9-93ea-cdd138c730ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:33.625550 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-3804a04c-cb65-40e9-93ea-cdd138c730ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:33.637333 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3804a04c-cb65-40e9-93ea-cdd138c730ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:33.638014 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3804a04c-cb65-40e9-93ea-cdd138c730ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:33.638758 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3804a04c-cb65-40e9-93ea-cdd138c730ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:33.639521 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3804a04c-cb65-40e9-93ea-cdd138c730ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:33.639979 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3804a04c-cb65-40e9-93ea-cdd138c730ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:33.640402 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-3804a04c-cb65-40e9-93ea-cdd138c730ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:33.848397 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-3804a04c-cb65-40e9-93ea-cdd138c730ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:33.859577 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-3804a04c-cb65-40e9-93ea-cdd138c730ec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1726 microversion: 2.1 time: 0.243161 Aug 23 22:29:33.860335 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 320/629] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:33 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:34.340751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b4803d4c-4935-41a5-b028-f44538ecc79a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:34.341380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b4803d4c-4935-41a5-b028-f44538ecc79a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:34.343869 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:34.350532 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4803d4c-4935-41a5-b028-f44538ecc79a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:34.351016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4803d4c-4935-41a5-b028-f44538ecc79a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:34.351450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4803d4c-4935-41a5-b028-f44538ecc79a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:34.352155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4803d4c-4935-41a5-b028-f44538ecc79a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:34.352598 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4803d4c-4935-41a5-b028-f44538ecc79a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:34.353014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b4803d4c-4935-41a5-b028-f44538ecc79a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:34.538126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b4803d4c-4935-41a5-b028-f44538ecc79a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:34.552754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b4803d4c-4935-41a5-b028-f44538ecc79a tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1510 microversion: 2.1 time: 0.215408 Aug 23 22:29:34.554145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 310/630] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:34 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:34.633152 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-424bd040-b696-41da-a7d8-33bf49c96d8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:34.634048 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-424bd040-b696-41da-a7d8-33bf49c96d8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:34.645177 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-424bd040-b696-41da-a7d8-33bf49c96d8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:34.646007 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-424bd040-b696-41da-a7d8-33bf49c96d8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:34.646794 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-424bd040-b696-41da-a7d8-33bf49c96d8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:34.647689 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-424bd040-b696-41da-a7d8-33bf49c96d8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:34.648359 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-424bd040-b696-41da-a7d8-33bf49c96d8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:34.649171 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-424bd040-b696-41da-a7d8-33bf49c96d8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:34.722266 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-424bd040-b696-41da-a7d8-33bf49c96d8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:34.734014 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-424bd040-b696-41da-a7d8-33bf49c96d8d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1294 microversion: 2.1 time: 0.108490 Aug 23 22:29:34.735077 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 321/631] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:34 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:34.885272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3e6fb90d-baf0-4b4d-a352-634c316fbb25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:34.886078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3e6fb90d-baf0-4b4d-a352-634c316fbb25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:34.892855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3e6fb90d-baf0-4b4d-a352-634c316fbb25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:34.893385 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3e6fb90d-baf0-4b4d-a352-634c316fbb25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:34.893812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3e6fb90d-baf0-4b4d-a352-634c316fbb25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:34.894511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3e6fb90d-baf0-4b4d-a352-634c316fbb25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:34.895002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3e6fb90d-baf0-4b4d-a352-634c316fbb25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:34.895416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3e6fb90d-baf0-4b4d-a352-634c316fbb25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:34.899134 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:35.149229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3e6fb90d-baf0-4b4d-a352-634c316fbb25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:35.166531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3e6fb90d-baf0-4b4d-a352-634c316fbb25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1726 microversion: 2.1 time: 0.286658 Aug 23 22:29:35.167589 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 311/632] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:34 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1726 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:35.360630 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-bc37f59d-7a4d-42e1-b355-a135a7e7bc30 req-c95cf467-337f-4a13-a866-cfcb0d34f565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0371a0e2-f3eb-4f94-a4c2-74e8335ce12e", "name": "network-vif-deleted", "tag": "c1e4982f-78f6-4b6f-a0dc-6cc910e101a8"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:35.377962 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-bc37f59d-7a4d-42e1-b355-a135a7e7bc30 req-c95cf467-337f-4a13-a866-cfcb0d34f565 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:35.378840 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-bc37f59d-7a4d-42e1-b355-a135a7e7bc30 req-c95cf467-337f-4a13-a866-cfcb0d34f565 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:35.380144 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-bc37f59d-7a4d-42e1-b355-a135a7e7bc30 req-c95cf467-337f-4a13-a866-cfcb0d34f565 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:35.395446 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-bc37f59d-7a4d-42e1-b355-a135a7e7bc30 req-c95cf467-337f-4a13-a866-cfcb0d34f565 service nova] Creating event network-vif-deleted:c1e4982f-78f6-4b6f-a0dc-6cc910e101a8 for instance 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e on hv-cinder-85032 Aug 23 22:29:35.400712 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-bc37f59d-7a4d-42e1-b355-a135a7e7bc30 req-c95cf467-337f-4a13-a866-cfcb0d34f565 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047003 Aug 23 22:29:35.401360 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 322/633] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:35.589849 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b9571921-ef2f-4e58-a84a-0c2f3d7aa342 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:35.590837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b9571921-ef2f-4e58-a84a-0c2f3d7aa342 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:35.599722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9571921-ef2f-4e58-a84a-0c2f3d7aa342 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:35.600380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9571921-ef2f-4e58-a84a-0c2f3d7aa342 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:35.601654 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9571921-ef2f-4e58-a84a-0c2f3d7aa342 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:35.601883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9571921-ef2f-4e58-a84a-0c2f3d7aa342 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:35.602254 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9571921-ef2f-4e58-a84a-0c2f3d7aa342 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:35.602687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9571921-ef2f-4e58-a84a-0c2f3d7aa342 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:35.679823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b9571921-ef2f-4e58-a84a-0c2f3d7aa342 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:35.688911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b9571921-ef2f-4e58-a84a-0c2f3d7aa342 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1468 microversion: 2.1 time: 0.104012 Aug 23 22:29:35.689540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 312/634] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:35 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1468 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:35.757636 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-71deb68f-bd05-43c9-9344-a2e2d128eb66 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:35.758442 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-71deb68f-bd05-43c9-9344-a2e2d128eb66 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:35.767541 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-71deb68f-bd05-43c9-9344-a2e2d128eb66 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:35.768321 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-71deb68f-bd05-43c9-9344-a2e2d128eb66 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:35.768980 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-71deb68f-bd05-43c9-9344-a2e2d128eb66 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:35.771590 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-71deb68f-bd05-43c9-9344-a2e2d128eb66 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:35.772213 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-71deb68f-bd05-43c9-9344-a2e2d128eb66 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:35.772653 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-71deb68f-bd05-43c9-9344-a2e2d128eb66 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:35.845936 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-71deb68f-bd05-43c9-9344-a2e2d128eb66 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:35.855623 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-71deb68f-bd05-43c9-9344-a2e2d128eb66 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1294 microversion: 2.1 time: 0.102839 Aug 23 22:29:35.856298 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 323/635] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:35 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:36.191445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b2060bd2-85d7-42da-a692-23ce75295877 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:36.192570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b2060bd2-85d7-42da-a692-23ce75295877 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:36.199419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2060bd2-85d7-42da-a692-23ce75295877 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:36.200027 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2060bd2-85d7-42da-a692-23ce75295877 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:36.200326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2060bd2-85d7-42da-a692-23ce75295877 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:36.201526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2060bd2-85d7-42da-a692-23ce75295877 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:36.201981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2060bd2-85d7-42da-a692-23ce75295877 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:36.202647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b2060bd2-85d7-42da-a692-23ce75295877 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:36.437111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b2060bd2-85d7-42da-a692-23ce75295877 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:36.446814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b2060bd2-85d7-42da-a692-23ce75295877 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1732 microversion: 2.1 time: 0.259536 Aug 23 22:29:36.447463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 313/636] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:36 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1732 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:36.469580 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-77b5ab0c-3ff1-494c-b087-532cf0faf7be tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:36.470141 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-77b5ab0c-3ff1-494c-b087-532cf0faf7be tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:36.478364 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-77b5ab0c-3ff1-494c-b087-532cf0faf7be tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:36.479184 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-77b5ab0c-3ff1-494c-b087-532cf0faf7be tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:36.479725 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-77b5ab0c-3ff1-494c-b087-532cf0faf7be tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:36.480451 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-77b5ab0c-3ff1-494c-b087-532cf0faf7be tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:36.481008 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-77b5ab0c-3ff1-494c-b087-532cf0faf7be tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:36.481462 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-77b5ab0c-3ff1-494c-b087-532cf0faf7be tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:36.579838 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-77b5ab0c-3ff1-494c-b087-532cf0faf7be tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114836 Aug 23 22:29:36.580746 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 324/637] 10.222.0.88 () {58 vars in 1275 bytes} [Tue Aug 23 22:29:36 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:36.719388 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:36.721702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:36.736085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:36.736909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:36.740515 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:36.742378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:36.744733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:36.746491 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:36.818313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:36.819639 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:36.820428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:36.821247 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lazy-loading 'fault' on Instance uuid 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:29:36.885000 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-ec397605-f6a6-4cb1-ac13-9490b22825d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:36.885773 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-ec397605-f6a6-4cb1-ac13-9490b22825d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:36.898585 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec397605-f6a6-4cb1-ac13-9490b22825d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:36.899475 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec397605-f6a6-4cb1-ac13-9490b22825d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:36.900265 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec397605-f6a6-4cb1-ac13-9490b22825d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:36.901562 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec397605-f6a6-4cb1-ac13-9490b22825d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:36.902443 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec397605-f6a6-4cb1-ac13-9490b22825d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:36.903114 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-ec397605-f6a6-4cb1-ac13-9490b22825d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:36.925963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:36.943973 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a2bf68d5-8fc6-4056-b32a-331b381a8734 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 200 len: 1308 microversion: 2.1 time: 0.233144 Aug 23 22:29:36.945540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 314/638] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:36 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:37.044892 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-ec397605-f6a6-4cb1-ac13-9490b22825d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:37.055209 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-ec397605-f6a6-4cb1-ac13-9490b22825d5 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1300 microversion: 2.1 time: 0.178866 Aug 23 22:29:37.055916 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 325/639] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:36 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:37.987751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:37.989317 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:38.001551 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:38.002441 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:38.003219 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:38.004612 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:38.005739 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:38.006533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:38.037831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] HTTP exception thrown: Instance 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e could not be found. Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Request method failure captured: Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e HTTP/1.1 Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVSEbDGLGzb_l-zVYUSfYg6ilurJ9PrxRh6isuSrv-aK9_uQqfmZfni-RcnqquLTO9iMubRJceky-Vdjz-2ZHnJG4algOlPcoNfywFOD--0A8AQsYqOqPsIKeoaaweDsWubf_8heEo6qsl7WD0ND3_bITN0fK15T1TiCg-vTIDpBHas Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 73aca04a5685447fb698a46da1b0b8ff Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesSnapshotTestJSON-79294332 Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:29:38.041273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/73aca04a5685447fb698a46da1b0b8ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_73aca04a5685447fb698a46da1b0b8ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/73aca04a5685447fb698a46da1b0b8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/73aca04a5685447fb698a46da1b0b8ff"}]}] Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesSnapshotTestJSON-79294332 Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 73aca04a5685447fb698a46da1b0b8ff Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-79294332 Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesSnapshotTestJSON-79294332-project Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 5918150a21314cf2b28bcee3072457ae Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesSnapshotTestJSON-79294332-project Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e could not be found. Aug 23 22:29:38.043878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '0371a0e2-f3eb-4f94-a4c2-74e8335ce12e'} Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e could not be found. Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:29:38.045633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e could not be found. Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e could not be found. Aug 23 22:29:38.052000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:38.056752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Returning 404 to user: Instance 0371a0e2-f3eb-4f94-a4c2-74e8335ce12e could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:29:38.056752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a5380f01-5d86-4462-bac4-0aa44534a4b1 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e" status: 404 len: 111 microversion: 2.1 time: 0.063411 Aug 23 22:29:38.056752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 315/640] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:37 2022] GET /compute/v2.1/servers/0371a0e2-f3eb-4f94-a4c2-74e8335ce12e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:29:38.092943 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-1bf345bd-0a1f-4a4c-9242-cd222113e392 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:38.094455 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-1bf345bd-0a1f-4a4c-9242-cd222113e392 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:38.103777 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1bf345bd-0a1f-4a4c-9242-cd222113e392 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:38.104357 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1bf345bd-0a1f-4a4c-9242-cd222113e392 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:38.104812 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1bf345bd-0a1f-4a4c-9242-cd222113e392 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:38.105684 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1bf345bd-0a1f-4a4c-9242-cd222113e392 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:38.106210 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1bf345bd-0a1f-4a4c-9242-cd222113e392 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:38.106653 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-1bf345bd-0a1f-4a4c-9242-cd222113e392 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:38.218185 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-1bf345bd-0a1f-4a4c-9242-cd222113e392 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:38.234540 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-1bf345bd-0a1f-4a4c-9242-cd222113e392 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1300 microversion: 2.1 time: 0.147789 Aug 23 22:29:38.236495 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 326/641] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:38 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1300 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:38.652394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-398e650d-2e81-44ef-b36f-f8fa29fc4adf req-c6681f52-1fff-4897-81a3-006929d1fa13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c1b881-065d-4348-9ce8-50b4cb96585c", "tag": "e22c6f1c-3320-443a-8bec-aafb2744b504"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:38.664702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-398e650d-2e81-44ef-b36f-f8fa29fc4adf req-c6681f52-1fff-4897-81a3-006929d1fa13 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:38.665482 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-398e650d-2e81-44ef-b36f-f8fa29fc4adf req-c6681f52-1fff-4897-81a3-006929d1fa13 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:38.666152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-398e650d-2e81-44ef-b36f-f8fa29fc4adf req-c6681f52-1fff-4897-81a3-006929d1fa13 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:38.692762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-398e650d-2e81-44ef-b36f-f8fa29fc4adf req-c6681f52-1fff-4897-81a3-006929d1fa13 service nova] Creating event network-changed:e22c6f1c-3320-443a-8bec-aafb2744b504 for instance d1c1b881-065d-4348-9ce8-50b4cb96585c on hv-cinder-85032 Aug 23 22:29:38.713910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-398e650d-2e81-44ef-b36f-f8fa29fc4adf req-c6681f52-1fff-4897-81a3-006929d1fa13 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063464 Aug 23 22:29:38.716293 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 316/642] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:39.271527 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-e0b6d0b6-0192-44e4-a201-6e2ed54e5d5c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:39.273746 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-e0b6d0b6-0192-44e4-a201-6e2ed54e5d5c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:39.285943 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e0b6d0b6-0192-44e4-a201-6e2ed54e5d5c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:39.287430 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e0b6d0b6-0192-44e4-a201-6e2ed54e5d5c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:39.288451 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e0b6d0b6-0192-44e4-a201-6e2ed54e5d5c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:39.289509 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e0b6d0b6-0192-44e4-a201-6e2ed54e5d5c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:39.290253 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e0b6d0b6-0192-44e4-a201-6e2ed54e5d5c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:39.290916 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-e0b6d0b6-0192-44e4-a201-6e2ed54e5d5c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:39.534039 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.policy [None req-e0b6d0b6-0192-44e4-a201-6e2ed54e5d5c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120855) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:39.546048 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [None req-e0b6d0b6-0192-44e4-a201-6e2ed54e5d5c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1368 microversion: 2.1 time: 0.282219 Aug 23 22:29:39.546742 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 327/643] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:39 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:40.567814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:40.568970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=12 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:40.574245 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6fe0749a-6cb7-4591-99ce-6965446bd22f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:40.574988 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6fe0749a-6cb7-4591-99ce-6965446bd22f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:40.583522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6fe0749a-6cb7-4591-99ce-6965446bd22f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:40.584027 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6fe0749a-6cb7-4591-99ce-6965446bd22f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:40.584459 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6fe0749a-6cb7-4591-99ce-6965446bd22f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:40.585212 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6fe0749a-6cb7-4591-99ce-6965446bd22f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:40.585660 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6fe0749a-6cb7-4591-99ce-6965446bd22f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:40.586081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6fe0749a-6cb7-4591-99ce-6965446bd22f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:40.758718 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [req-8aabb0a8-8173-44e3-a188-2ee63bc715cc req-f69c5728-1f6c-4771-8eb5-ea038c6151e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c1b881-065d-4348-9ce8-50b4cb96585c", "tag": "e22c6f1c-3320-443a-8bec-aafb2744b504"}, {"name": "network-changed", "server_uuid": "c789ef3c-a649-4967-a49e-e8ce958cc666", "tag": "faa98708-0963-4cbe-98f1-6a55b7e5c07d"}]} {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:40.780663 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-8aabb0a8-8173-44e3-a188-2ee63bc715cc req-f69c5728-1f6c-4771-8eb5-ea038c6151e5 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:40.781505 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-8aabb0a8-8173-44e3-a188-2ee63bc715cc req-f69c5728-1f6c-4771-8eb5-ea038c6151e5 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:40.782283 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [req-8aabb0a8-8173-44e3-a188-2ee63bc715cc req-f69c5728-1f6c-4771-8eb5-ea038c6151e5 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:40.787388 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6fe0749a-6cb7-4591-99ce-6965446bd22f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:40.799288 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6fe0749a-6cb7-4591-99ce-6965446bd22f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1368 microversion: 2.1 time: 0.233452 Aug 23 22:29:40.800224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 317/644] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:40 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:40.801888 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-8aabb0a8-8173-44e3-a188-2ee63bc715cc req-f69c5728-1f6c-4771-8eb5-ea038c6151e5 service nova] Creating event network-changed:e22c6f1c-3320-443a-8bec-aafb2744b504 for instance d1c1b881-065d-4348-9ce8-50b4cb96585c on hv-cinder-85032 Aug 23 22:29:40.802473 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.compute.server_external_events [req-8aabb0a8-8173-44e3-a188-2ee63bc715cc req-f69c5728-1f6c-4771-8eb5-ea038c6151e5 service nova] Creating event network-changed:faa98708-0963-4cbe-98f1-6a55b7e5c07d for instance c789ef3c-a649-4967-a49e-e8ce958cc666 on hv-cinder-85032 Aug 23 22:29:40.809618 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: INFO nova.api.openstack.requestlog [req-8aabb0a8-8173-44e3-a188-2ee63bc715cc req-f69c5728-1f6c-4771-8eb5-ea038c6151e5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055459 Aug 23 22:29:40.810080 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: [pid: 120855|app: 0|req: 328/645] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:29:41.465237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1ef72080-1ab6-4b8f-8db4-719da7107fc9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1688991145"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:41.465771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1ef72080-1ab6-4b8f-8db4-719da7107fc9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:41.472051 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1ef72080-1ab6-4b8f-8db4-719da7107fc9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:41.472535 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1ef72080-1ab6-4b8f-8db4-719da7107fc9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:41.473529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1ef72080-1ab6-4b8f-8db4-719da7107fc9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:41.474362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1ef72080-1ab6-4b8f-8db4-719da7107fc9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:41.475510 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1ef72080-1ab6-4b8f-8db4-719da7107fc9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:41.475510 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1ef72080-1ab6-4b8f-8db4-719da7107fc9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:41.856413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.network.security_group_api [None req-1ef72080-1ab6-4b8f-8db4-719da7107fc9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Removing security group aa6ccaf7-521c-4684-8cc3-34c22f4fb4a3 from port e9f61e27-4256-4ba2-904d-a608368e989b Aug 23 22:29:41.959248 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.api.openstack.wsgi [None req-b276e6fe-c3b8-4ead-9363-ffa36004963f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:41.960494 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG nova.compute.api [None req-b276e6fe-c3b8-4ead-9363-ffa36004963f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120855) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:41.974350 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b276e6fe-c3b8-4ead-9363-ffa36004963f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:41.975282 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b276e6fe-c3b8-4ead-9363-ffa36004963f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:41.975995 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: DEBUG oslo_concurrency.lockutils [None req-b276e6fe-c3b8-4ead-9363-ffa36004963f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:42.001644 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: Traceback (most recent call last): Aug 23 22:29:42.001955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 23 22:29:42.001955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: timer() Aug 23 22:29:42.001955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 23 22:29:42.001955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: cb(*args, **kw) Aug 23 22:29:42.001955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 23 22:29:42.001955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: waiter.switch() Aug 23 22:29:42.001955 dv-cinder-850321-4-iscsi devstack@n-api.service[120855]: greenlet.error: cannot switch to a different thread Aug 23 22:29:42.920777 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1ef72080-1ab6-4b8f-8db4-719da7107fc9 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "POST /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/action" status: 202 len: 0 microversion: 2.1 time: 1.459526 Aug 23 22:29:42.921724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 318/646] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:29:41 2022] POST /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/action => generated 0 bytes in 1461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:29:42.944321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-c65a815d-eb11-4473-bddd-35e3f6d70c7b req-d7004622-5136-444c-ab71-26629dd224f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30f307e-cf90-4c02-ab66-f16d7bc4b427", "tag": "e9f61e27-4256-4ba2-904d-a608368e989b"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:42.969009 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-c65a815d-eb11-4473-bddd-35e3f6d70c7b req-d7004622-5136-444c-ab71-26629dd224f3 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:42.972037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-c65a815d-eb11-4473-bddd-35e3f6d70c7b req-d7004622-5136-444c-ab71-26629dd224f3 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:42.975207 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-c65a815d-eb11-4473-bddd-35e3f6d70c7b req-d7004622-5136-444c-ab71-26629dd224f3 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:43.005619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-c65a815d-eb11-4473-bddd-35e3f6d70c7b req-d7004622-5136-444c-ab71-26629dd224f3 service nova] Creating event network-changed:e9f61e27-4256-4ba2-904d-a608368e989b for instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 on hv-cinder-85032 Aug 23 22:29:43.016764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-c65a815d-eb11-4473-bddd-35e3f6d70c7b req-d7004622-5136-444c-ab71-26629dd224f3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083321 Aug 23 22:29:43.022570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 319/647] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:43.568998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-eefeb9e8-2197-4659-ba85-a8f2213149aa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:43.570141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-eefeb9e8-2197-4659-ba85-a8f2213149aa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:43.584910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eefeb9e8-2197-4659-ba85-a8f2213149aa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:43.585906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eefeb9e8-2197-4659-ba85-a8f2213149aa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:43.586690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eefeb9e8-2197-4659-ba85-a8f2213149aa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:43.588042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eefeb9e8-2197-4659-ba85-a8f2213149aa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:43.588909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eefeb9e8-2197-4659-ba85-a8f2213149aa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:43.589709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eefeb9e8-2197-4659-ba85-a8f2213149aa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:43.652283 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-eefeb9e8-2197-4659-ba85-a8f2213149aa tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments/e0069771-bf40-406a-bef2-b913cfacec93" status: 200 len: 194 microversion: 2.20 time: 0.278158 Aug 23 22:29:43.653641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 320/648] 10.222.0.88 () {60 vars in 1454 bytes} [Tue Aug 23 22:29:43 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments/e0069771-bf40-406a-bef2-b913cfacec93 => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:29:43.777288 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b9d29018-1870-474d-a68b-2f2e3bceeb71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:43.778184 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b9d29018-1870-474d-a68b-2f2e3bceeb71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:43.789888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9d29018-1870-474d-a68b-2f2e3bceeb71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:43.790744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9d29018-1870-474d-a68b-2f2e3bceeb71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:43.791534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9d29018-1870-474d-a68b-2f2e3bceeb71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:43.792843 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9d29018-1870-474d-a68b-2f2e3bceeb71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:43.793706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9d29018-1870-474d-a68b-2f2e3bceeb71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:43.794538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9d29018-1870-474d-a68b-2f2e3bceeb71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:43.911589 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-b9d29018-1870-474d-a68b-2f2e3bceeb71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lazy-loading 'services' on Instance uuid 80b697da-19f2-459e-a57e-e386523e4bcf {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:29:44.037505 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b9d29018-1870-474d-a68b-2f2e3bceeb71 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "DELETE /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments/e0069771-bf40-406a-bef2-b913cfacec93" status: 202 len: 0 microversion: 2.20 time: 0.266913 Aug 23 22:29:44.038664 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 321/649] 10.222.0.88 () {60 vars in 1457 bytes} [Tue Aug 23 22:29:43 2022] DELETE /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments/e0069771-bf40-406a-bef2-b913cfacec93 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:29:44.050203 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c2a64a5a-32ce-421a-ac74-748af4a653b5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:44.054036 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c2a64a5a-32ce-421a-ac74-748af4a653b5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:44.063691 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c2a64a5a-32ce-421a-ac74-748af4a653b5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:44.064689 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c2a64a5a-32ce-421a-ac74-748af4a653b5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:44.065504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c2a64a5a-32ce-421a-ac74-748af4a653b5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:44.067484 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c2a64a5a-32ce-421a-ac74-748af4a653b5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:44.068582 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c2a64a5a-32ce-421a-ac74-748af4a653b5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:44.069362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c2a64a5a-32ce-421a-ac74-748af4a653b5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:44.129319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c2a64a5a-32ce-421a-ac74-748af4a653b5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083730 Aug 23 22:29:44.130404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 322/650] 10.222.0.88 () {60 vars in 1343 bytes} [Tue Aug 23 22:29:44 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:29:44.437206 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-03bcc3ce-1f11-4c66-a77e-495bb10aab85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:44.438048 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-03bcc3ce-1f11-4c66-a77e-495bb10aab85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:44.448789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03bcc3ce-1f11-4c66-a77e-495bb10aab85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:44.449683 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03bcc3ce-1f11-4c66-a77e-495bb10aab85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:44.450466 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03bcc3ce-1f11-4c66-a77e-495bb10aab85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:44.451857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03bcc3ce-1f11-4c66-a77e-495bb10aab85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:44.452714 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03bcc3ce-1f11-4c66-a77e-495bb10aab85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:44.453514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03bcc3ce-1f11-4c66-a77e-495bb10aab85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:44.584950 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-03bcc3ce-1f11-4c66-a77e-495bb10aab85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lazy-loading 'services' on Instance uuid a30f307e-cf90-4c02-ab66-f16d7bc4b427 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:29:44.681944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-03bcc3ce-1f11-4c66-a77e-495bb10aab85 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments/7135e762-c27b-44c2-9cba-700a7efa015a" status: 202 len: 0 microversion: 2.1 time: 0.252317 Aug 23 22:29:44.682881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 323/651] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:29:44 2022] DELETE /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments/7135e762-c27b-44c2-9cba-700a7efa015a => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:29:44.692311 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-97f35513-cff7-45eb-aa0c-0056ce7a2a74 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:44.695461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-97f35513-cff7-45eb-aa0c-0056ce7a2a74 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:44.703607 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-97f35513-cff7-45eb-aa0c-0056ce7a2a74 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:44.704094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-97f35513-cff7-45eb-aa0c-0056ce7a2a74 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:44.704534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-97f35513-cff7-45eb-aa0c-0056ce7a2a74 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:44.705306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-97f35513-cff7-45eb-aa0c-0056ce7a2a74 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:44.705775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-97f35513-cff7-45eb-aa0c-0056ce7a2a74 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:44.706210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-97f35513-cff7-45eb-aa0c-0056ce7a2a74 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:44.742865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-97f35513-cff7-45eb-aa0c-0056ce7a2a74 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055221 Aug 23 22:29:44.743705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 324/652] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:44 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:29:45.059235 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-6b25d280-4753-4b50-b179-2764476fe668 req-9583d024-d6b9-41f6-9dfb-7229dfa7955c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30f307e-cf90-4c02-ab66-f16d7bc4b427", "tag": "e9f61e27-4256-4ba2-904d-a608368e989b"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:45.076313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-6b25d280-4753-4b50-b179-2764476fe668 req-9583d024-d6b9-41f6-9dfb-7229dfa7955c service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:45.077093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-6b25d280-4753-4b50-b179-2764476fe668 req-9583d024-d6b9-41f6-9dfb-7229dfa7955c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:45.077858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-6b25d280-4753-4b50-b179-2764476fe668 req-9583d024-d6b9-41f6-9dfb-7229dfa7955c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:45.101093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-6b25d280-4753-4b50-b179-2764476fe668 req-9583d024-d6b9-41f6-9dfb-7229dfa7955c service nova] Creating event network-changed:e9f61e27-4256-4ba2-904d-a608368e989b for instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 on hv-cinder-85032 Aug 23 22:29:45.109072 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-6b25d280-4753-4b50-b179-2764476fe668 req-9583d024-d6b9-41f6-9dfb-7229dfa7955c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058503 Aug 23 22:29:45.109780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 325/653] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:29:45.148964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bf999157-f259-4e6d-aa01-5a35a6c3badf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:45.152887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bf999157-f259-4e6d-aa01-5a35a6c3badf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:45.165132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bf999157-f259-4e6d-aa01-5a35a6c3badf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:45.165713 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bf999157-f259-4e6d-aa01-5a35a6c3badf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:45.166496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bf999157-f259-4e6d-aa01-5a35a6c3badf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:45.167747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bf999157-f259-4e6d-aa01-5a35a6c3badf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:45.168564 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bf999157-f259-4e6d-aa01-5a35a6c3badf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:45.169349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bf999157-f259-4e6d-aa01-5a35a6c3badf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:45.212246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bf999157-f259-4e6d-aa01-5a35a6c3badf tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070864 Aug 23 22:29:45.212844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 326/654] 10.222.0.88 () {60 vars in 1343 bytes} [Tue Aug 23 22:29:45 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:29:45.757322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-beaaf45d-3f39-424b-9722-f826ba3b29a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:45.759522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-beaaf45d-3f39-424b-9722-f826ba3b29a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:45.766392 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-beaaf45d-3f39-424b-9722-f826ba3b29a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:45.766883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-beaaf45d-3f39-424b-9722-f826ba3b29a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:45.767320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-beaaf45d-3f39-424b-9722-f826ba3b29a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:45.768025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-beaaf45d-3f39-424b-9722-f826ba3b29a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:45.768484 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-beaaf45d-3f39-424b-9722-f826ba3b29a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:45.768910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-beaaf45d-3f39-424b-9722-f826ba3b29a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:45.805320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-beaaf45d-3f39-424b-9722-f826ba3b29a1 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053348 Aug 23 22:29:45.805923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 327/655] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:45 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:29:46.227001 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-145ff562-4b15-4d5b-af4c-1de9e4bedb2d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:46.229286 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-145ff562-4b15-4d5b-af4c-1de9e4bedb2d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:46.235635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-145ff562-4b15-4d5b-af4c-1de9e4bedb2d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:46.236167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-145ff562-4b15-4d5b-af4c-1de9e4bedb2d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:46.236680 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-145ff562-4b15-4d5b-af4c-1de9e4bedb2d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:46.237569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-145ff562-4b15-4d5b-af4c-1de9e4bedb2d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:46.238041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-145ff562-4b15-4d5b-af4c-1de9e4bedb2d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:46.238775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-145ff562-4b15-4d5b-af4c-1de9e4bedb2d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:46.276099 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-145ff562-4b15-4d5b-af4c-1de9e4bedb2d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054373 Aug 23 22:29:46.276899 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 328/656] 10.222.0.88 () {60 vars in 1343 bytes} [Tue Aug 23 22:29:46 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:29:46.426034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1797801524", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "networks": [{"uuid": "5bddff4f-8ee4-4f70-b11a-45aed32fa202"}]}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:46.523827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] validate_networks() for [('5bddff4f-8ee4-4f70-b11a-45aed32fa202', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:29:47.043940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:29:47.044354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:29:47.044979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:29:47.045416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:29:47.045825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:29:47.056499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.056978 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.057448 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.058172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.058635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.059157 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.067236 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:47.081437 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Getting quotas for project 73aca04a5685447fb698a46da1b0b8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:29:47.087229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Getting quotas for user 5918150a21314cf2b28bcee3072457ae and project 73aca04a5685447fb698a46da1b0b8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:29:47.100761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:29:47.103184 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:29:47.155164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-494bcf35-7a22-4b62-84b8-8687681b35c5 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733327 Aug 23 22:29:47.167329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 329/657] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:29:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:29:47.167329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b8f70351-0e8f-421f-8461-d3e505d625c2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:47.167329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b8f70351-0e8f-421f-8461-d3e505d625c2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:47.173397 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8f70351-0e8f-421f-8461-d3e505d625c2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.173992 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8f70351-0e8f-421f-8461-d3e505d625c2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.174344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8f70351-0e8f-421f-8461-d3e505d625c2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.175508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8f70351-0e8f-421f-8461-d3e505d625c2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.175508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8f70351-0e8f-421f-8461-d3e505d625c2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.176610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8f70351-0e8f-421f-8461-d3e505d625c2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.230109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b8f70351-0e8f-421f-8461-d3e505d625c2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072996 Aug 23 22:29:47.231174 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 330/658] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:47 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:29:47.236930 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b410baab-1a13-49cf-a4a3-30f1e90a7cb0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:47.239565 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b410baab-1a13-49cf-a4a3-30f1e90a7cb0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:47.246533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b410baab-1a13-49cf-a4a3-30f1e90a7cb0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.247380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b410baab-1a13-49cf-a4a3-30f1e90a7cb0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.248029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b410baab-1a13-49cf-a4a3-30f1e90a7cb0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.248937 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b410baab-1a13-49cf-a4a3-30f1e90a7cb0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.249696 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b410baab-1a13-49cf-a4a3-30f1e90a7cb0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.250612 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b410baab-1a13-49cf-a4a3-30f1e90a7cb0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.306919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b410baab-1a13-49cf-a4a3-30f1e90a7cb0 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074016 Aug 23 22:29:47.307722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 331/659] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:47 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:47.313543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2f325a7c-0fe4-4ac5-ae72-7fb66ab21f70 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:47.314991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2f325a7c-0fe4-4ac5-ae72-7fb66ab21f70 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:47.437361 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2f325a7c-0fe4-4ac5-ae72-7fb66ab21f70 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:47.448713 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2f325a7c-0fe4-4ac5-ae72-7fb66ab21f70 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1219 microversion: 2.1 time: 0.139601 Aug 23 22:29:47.450149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 332/660] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:47 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1219 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:47.456630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-dd419f33-bb61-476a-8054-96b727702e74 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:47.460944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-dd419f33-bb61-476a-8054-96b727702e74 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:47.469861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dd419f33-bb61-476a-8054-96b727702e74 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.470469 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dd419f33-bb61-476a-8054-96b727702e74 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.470961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dd419f33-bb61-476a-8054-96b727702e74 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.471694 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dd419f33-bb61-476a-8054-96b727702e74 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.472155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dd419f33-bb61-476a-8054-96b727702e74 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.472579 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dd419f33-bb61-476a-8054-96b727702e74 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.518322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-dd419f33-bb61-476a-8054-96b727702e74 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065696 Aug 23 22:29:47.521321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 333/661] 10.222.0.88 () {60 vars in 1343 bytes} [Tue Aug 23 22:29:47 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:29:47.539576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4eb44221-6b98-47f7-97ec-dd5adec85cfa tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:47.540363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4eb44221-6b98-47f7-97ec-dd5adec85cfa tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:47.549607 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4eb44221-6b98-47f7-97ec-dd5adec85cfa tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.550315 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4eb44221-6b98-47f7-97ec-dd5adec85cfa tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.551094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4eb44221-6b98-47f7-97ec-dd5adec85cfa tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.552896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4eb44221-6b98-47f7-97ec-dd5adec85cfa tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.553746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4eb44221-6b98-47f7-97ec-dd5adec85cfa tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.554272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4eb44221-6b98-47f7-97ec-dd5adec85cfa tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.585093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4eb44221-6b98-47f7-97ec-dd5adec85cfa tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:29:47.702859 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4eb44221-6b98-47f7-97ec-dd5adec85cfa tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 204 len: 0 microversion: 2.1 time: 0.178113 Aug 23 22:29:47.703613 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 334/662] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:29:47 2022] DELETE /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:29:47.730389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-219ae330-b522-4d0f-9213-ecc25b804b96 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:47.731363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-219ae330-b522-4d0f-9213-ecc25b804b96 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:47.747597 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-219ae330-b522-4d0f-9213-ecc25b804b96 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.750320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-219ae330-b522-4d0f-9213-ecc25b804b96 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.751784 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-219ae330-b522-4d0f-9213-ecc25b804b96 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.753691 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-219ae330-b522-4d0f-9213-ecc25b804b96 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:47.753691 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-219ae330-b522-4d0f-9213-ecc25b804b96 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:47.754909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-219ae330-b522-4d0f-9213-ecc25b804b96 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:47.933514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-219ae330-b522-4d0f-9213-ecc25b804b96 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:47.942554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-219ae330-b522-4d0f-9213-ecc25b804b96 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1673 microversion: 2.1 time: 0.230374 Aug 23 22:29:47.943495 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 335/663] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:47 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1673 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:48.320701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-470a2291-319c-47e8-bffd-35f83b0e011c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:48.323080 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-470a2291-319c-47e8-bffd-35f83b0e011c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:48.330168 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-470a2291-319c-47e8-bffd-35f83b0e011c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:48.330663 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-470a2291-319c-47e8-bffd-35f83b0e011c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:48.331232 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-470a2291-319c-47e8-bffd-35f83b0e011c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:48.331962 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-470a2291-319c-47e8-bffd-35f83b0e011c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:48.333041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-470a2291-319c-47e8-bffd-35f83b0e011c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:48.333041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-470a2291-319c-47e8-bffd-35f83b0e011c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:48.369606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-470a2291-319c-47e8-bffd-35f83b0e011c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053553 Aug 23 22:29:48.370212 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 336/664] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:48 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:29:48.471700 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-72f51769-6989-4801-9830-41f5427aac92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:48.472384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-72f51769-6989-4801-9830-41f5427aac92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:48.479537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-72f51769-6989-4801-9830-41f5427aac92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:48.480028 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-72f51769-6989-4801-9830-41f5427aac92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:48.480456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-72f51769-6989-4801-9830-41f5427aac92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:48.481296 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-72f51769-6989-4801-9830-41f5427aac92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:48.481758 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-72f51769-6989-4801-9830-41f5427aac92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:48.482241 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-72f51769-6989-4801-9830-41f5427aac92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:48.557083 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-72f51769-6989-4801-9830-41f5427aac92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:48.566402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-72f51769-6989-4801-9830-41f5427aac92 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1223 microversion: 2.1 time: 0.099104 Aug 23 22:29:48.567963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 337/665] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:48 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:48.576653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fb6ac81a-b692-4b37-81e7-1ec3efb8d2fe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:48.579378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fb6ac81a-b692-4b37-81e7-1ec3efb8d2fe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:48.587811 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fb6ac81a-b692-4b37-81e7-1ec3efb8d2fe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:48.588363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fb6ac81a-b692-4b37-81e7-1ec3efb8d2fe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:48.588872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fb6ac81a-b692-4b37-81e7-1ec3efb8d2fe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:48.589711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fb6ac81a-b692-4b37-81e7-1ec3efb8d2fe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:48.590229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fb6ac81a-b692-4b37-81e7-1ec3efb8d2fe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:48.590701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fb6ac81a-b692-4b37-81e7-1ec3efb8d2fe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:48.624419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fb6ac81a-b692-4b37-81e7-1ec3efb8d2fe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054956 Aug 23 22:29:48.625005 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 338/666] 10.222.0.88 () {60 vars in 1343 bytes} [Tue Aug 23 22:29:48 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:29:48.969197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-88ae97ed-5cb1-4eee-8edc-d11209fd1d7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:48.971581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-88ae97ed-5cb1-4eee-8edc-d11209fd1d7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:48.977946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88ae97ed-5cb1-4eee-8edc-d11209fd1d7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:48.978427 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88ae97ed-5cb1-4eee-8edc-d11209fd1d7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:48.978861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88ae97ed-5cb1-4eee-8edc-d11209fd1d7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:48.979556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88ae97ed-5cb1-4eee-8edc-d11209fd1d7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:48.980063 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88ae97ed-5cb1-4eee-8edc-d11209fd1d7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:48.980426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88ae97ed-5cb1-4eee-8edc-d11209fd1d7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:49.121622 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-88ae97ed-5cb1-4eee-8edc-d11209fd1d7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:49.130846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-88ae97ed-5cb1-4eee-8edc-d11209fd1d7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1673 microversion: 2.1 time: 0.168921 Aug 23 22:29:49.131443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 339/667] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:48 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:49.383606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2708e99b-2d58-405f-bd5c-2f7be410b6de tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:49.386042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2708e99b-2d58-405f-bd5c-2f7be410b6de tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:49.392422 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2708e99b-2d58-405f-bd5c-2f7be410b6de tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:49.392901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2708e99b-2d58-405f-bd5c-2f7be410b6de tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:49.393359 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2708e99b-2d58-405f-bd5c-2f7be410b6de tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:49.394058 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2708e99b-2d58-405f-bd5c-2f7be410b6de tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:49.395044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2708e99b-2d58-405f-bd5c-2f7be410b6de tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:49.395628 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2708e99b-2d58-405f-bd5c-2f7be410b6de tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:49.427078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2708e99b-2d58-405f-bd5c-2f7be410b6de tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048781 Aug 23 22:29:49.427640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 340/668] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:49 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:29:49.594160 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-56bfaf03-9f04-461c-8991-00d156ed1f35 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:49.594761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-56bfaf03-9f04-461c-8991-00d156ed1f35 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:49.600966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56bfaf03-9f04-461c-8991-00d156ed1f35 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:49.601468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56bfaf03-9f04-461c-8991-00d156ed1f35 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:49.601897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56bfaf03-9f04-461c-8991-00d156ed1f35 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:49.602570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56bfaf03-9f04-461c-8991-00d156ed1f35 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:49.603017 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56bfaf03-9f04-461c-8991-00d156ed1f35 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:49.603432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-56bfaf03-9f04-461c-8991-00d156ed1f35 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:49.668537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-56bfaf03-9f04-461c-8991-00d156ed1f35 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:49.677247 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-56bfaf03-9f04-461c-8991-00d156ed1f35 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1223 microversion: 2.1 time: 0.086787 Aug 23 22:29:49.677837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 341/669] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:49 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:49.682828 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d52566f1-5e20-4284-aa9d-694808d84207 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:49.684990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d52566f1-5e20-4284-aa9d-694808d84207 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:49.692591 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d52566f1-5e20-4284-aa9d-694808d84207 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:49.693322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d52566f1-5e20-4284-aa9d-694808d84207 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:49.693760 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d52566f1-5e20-4284-aa9d-694808d84207 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:49.694502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d52566f1-5e20-4284-aa9d-694808d84207 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:49.694995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d52566f1-5e20-4284-aa9d-694808d84207 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:49.695417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d52566f1-5e20-4284-aa9d-694808d84207 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:49.733277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d52566f1-5e20-4284-aa9d-694808d84207 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053665 Aug 23 22:29:49.734473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 342/670] 10.222.0.88 () {60 vars in 1343 bytes} [Tue Aug 23 22:29:49 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:29:50.152287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ab1f336e-5502-412b-8217-75fbf50e55a1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:50.153671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ab1f336e-5502-412b-8217-75fbf50e55a1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:50.161707 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab1f336e-5502-412b-8217-75fbf50e55a1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:50.162519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab1f336e-5502-412b-8217-75fbf50e55a1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:50.163251 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab1f336e-5502-412b-8217-75fbf50e55a1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:50.164136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab1f336e-5502-412b-8217-75fbf50e55a1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:50.164733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab1f336e-5502-412b-8217-75fbf50e55a1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:50.165370 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab1f336e-5502-412b-8217-75fbf50e55a1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:50.914656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ab1f336e-5502-412b-8217-75fbf50e55a1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:50.923195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ab1f336e-5502-412b-8217-75fbf50e55a1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1673 microversion: 2.1 time: 0.774758 Aug 23 22:29:50.923826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 343/671] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:50 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1673 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:50.943297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-7e9bb21c-9595-4222-bae1-d11eb33d512b req-83ad0db2-a231-4d26-9f1b-a70e9789257e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c789ef3c-a649-4967-a49e-e8ce958cc666", "name": "network-vif-plugged", "status": "completed", "tag": "faa98708-0963-4cbe-98f1-6a55b7e5c07d"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:50.956034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7e9bb21c-9595-4222-bae1-d11eb33d512b req-83ad0db2-a231-4d26-9f1b-a70e9789257e service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:50.956516 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7e9bb21c-9595-4222-bae1-d11eb33d512b req-83ad0db2-a231-4d26-9f1b-a70e9789257e service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:50.956960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7e9bb21c-9595-4222-bae1-d11eb33d512b req-83ad0db2-a231-4d26-9f1b-a70e9789257e service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:50.968335 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-7e9bb21c-9595-4222-bae1-d11eb33d512b req-83ad0db2-a231-4d26-9f1b-a70e9789257e service nova] Creating event network-vif-plugged:faa98708-0963-4cbe-98f1-6a55b7e5c07d for instance c789ef3c-a649-4967-a49e-e8ce958cc666 on hv-cinder-85032 Aug 23 22:29:50.973420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-7e9bb21c-9595-4222-bae1-d11eb33d512b req-83ad0db2-a231-4d26-9f1b-a70e9789257e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035036 Aug 23 22:29:50.974019 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 344/672] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:50.979154 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0f151f4c-6e75-4b10-8c14-26f1c9fb8c3c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:50.981408 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0f151f4c-6e75-4b10-8c14-26f1c9fb8c3c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:50.987661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f151f4c-6e75-4b10-8c14-26f1c9fb8c3c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:50.988665 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f151f4c-6e75-4b10-8c14-26f1c9fb8c3c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:50.989100 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f151f4c-6e75-4b10-8c14-26f1c9fb8c3c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:50.989799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f151f4c-6e75-4b10-8c14-26f1c9fb8c3c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:50.990261 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f151f4c-6e75-4b10-8c14-26f1c9fb8c3c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:50.990667 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f151f4c-6e75-4b10-8c14-26f1c9fb8c3c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:51.028628 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0f151f4c-6e75-4b10-8c14-26f1c9fb8c3c tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053278 Aug 23 22:29:51.029136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 345/673] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:50 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:51.034243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b7fe5d6b-70c3-47fd-8c0c-ed3b4e0ac7d2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:51.034845 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b7fe5d6b-70c3-47fd-8c0c-ed3b4e0ac7d2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:51.042179 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fe5d6b-70c3-47fd-8c0c-ed3b4e0ac7d2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:51.042669 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fe5d6b-70c3-47fd-8c0c-ed3b4e0ac7d2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:51.043138 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fe5d6b-70c3-47fd-8c0c-ed3b4e0ac7d2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:51.043846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fe5d6b-70c3-47fd-8c0c-ed3b4e0ac7d2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:51.044389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fe5d6b-70c3-47fd-8c0c-ed3b4e0ac7d2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:51.045027 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fe5d6b-70c3-47fd-8c0c-ed3b4e0ac7d2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:51.064428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:51.124454 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b7fe5d6b-70c3-47fd-8c0c-ed3b4e0ac7d2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:51.132648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b7fe5d6b-70c3-47fd-8c0c-ed3b4e0ac7d2 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1271 microversion: 2.1 time: 0.102380 Aug 23 22:29:51.133392 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 346/674] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:51 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:51.138518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-03ab91dc-df75-4714-b840-66fa6e5ace2c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:51.140728 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-03ab91dc-df75-4714-b840-66fa6e5ace2c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:51.147934 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03ab91dc-df75-4714-b840-66fa6e5ace2c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:51.148414 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03ab91dc-df75-4714-b840-66fa6e5ace2c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:51.148861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03ab91dc-df75-4714-b840-66fa6e5ace2c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:51.149598 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03ab91dc-df75-4714-b840-66fa6e5ace2c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:51.150199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03ab91dc-df75-4714-b840-66fa6e5ace2c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:51.151037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-03ab91dc-df75-4714-b840-66fa6e5ace2c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:51.198766 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-03ab91dc-df75-4714-b840-66fa6e5ace2c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063690 Aug 23 22:29:51.209292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 347/675] 10.222.0.88 () {60 vars in 1343 bytes} [Tue Aug 23 22:29:51 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:51.352308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cc4dbc1f-3e9e-4f54-b69a-ae21cf7dc6a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:51.352820 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cc4dbc1f-3e9e-4f54-b69a-ae21cf7dc6a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:51.355743 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:51.371343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc4dbc1f-3e9e-4f54-b69a-ae21cf7dc6a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:51.371918 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc4dbc1f-3e9e-4f54-b69a-ae21cf7dc6a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:51.372370 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc4dbc1f-3e9e-4f54-b69a-ae21cf7dc6a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:51.375058 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc4dbc1f-3e9e-4f54-b69a-ae21cf7dc6a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:51.375681 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc4dbc1f-3e9e-4f54-b69a-ae21cf7dc6a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:51.376219 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cc4dbc1f-3e9e-4f54-b69a-ae21cf7dc6a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:51.476812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cc4dbc1f-3e9e-4f54-b69a-ae21cf7dc6a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:29:51.603584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cc4dbc1f-3e9e-4f54-b69a-ae21cf7dc6a6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "DELETE /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 204 len: 0 microversion: 2.20 time: 0.256909 Aug 23 22:29:51.604630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 348/676] 10.222.0.88 () {60 vars in 1280 bytes} [Tue Aug 23 22:29:51 2022] DELETE /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 22:29:51.617206 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:51.618212 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:51.625428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:51.625928 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:51.626539 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:51.627487 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:51.627974 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:51.628392 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:51.928514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:51.940007 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:51.942955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:51.945221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3efd334c-5c97-4961-a404-75814b805e56 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.333408 Aug 23 22:29:51.946131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 349/677] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:29:51 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:29:51.951725 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9fabdac2-d24e-4ec6-a863-3a06484402ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:51.952709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9fabdac2-d24e-4ec6-a863-3a06484402ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:51.965557 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fabdac2-d24e-4ec6-a863-3a06484402ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:51.966058 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fabdac2-d24e-4ec6-a863-3a06484402ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:51.966493 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fabdac2-d24e-4ec6-a863-3a06484402ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:51.967213 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fabdac2-d24e-4ec6-a863-3a06484402ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:51.967666 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fabdac2-d24e-4ec6-a863-3a06484402ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:51.968095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fabdac2-d24e-4ec6-a863-3a06484402ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:52.228396 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9fabdac2-d24e-4ec6-a863-3a06484402ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:52.240120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9fabdac2-d24e-4ec6-a863-3a06484402ac tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1673 microversion: 2.1 time: 0.292956 Aug 23 22:29:52.241094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 350/678] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:51 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1673 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:52.254461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-816e712f-b0dd-4e92-bd7f-56bdef7f6214 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:52.254461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-816e712f-b0dd-4e92-bd7f-56bdef7f6214 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:52.261149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-816e712f-b0dd-4e92-bd7f-56bdef7f6214 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:52.261727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-816e712f-b0dd-4e92-bd7f-56bdef7f6214 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:52.262356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-816e712f-b0dd-4e92-bd7f-56bdef7f6214 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:52.263577 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-816e712f-b0dd-4e92-bd7f-56bdef7f6214 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:52.264503 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-816e712f-b0dd-4e92-bd7f-56bdef7f6214 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:52.264950 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-816e712f-b0dd-4e92-bd7f-56bdef7f6214 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:52.303576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-816e712f-b0dd-4e92-bd7f-56bdef7f6214 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060958 Aug 23 22:29:52.304509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 351/679] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:29:52 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:29:52.309557 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-011788ee-d967-4355-96d3-42b8d781e6f9 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:52.310391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-011788ee-d967-4355-96d3-42b8d781e6f9 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:52.317625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-011788ee-d967-4355-96d3-42b8d781e6f9 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:52.318352 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-011788ee-d967-4355-96d3-42b8d781e6f9 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:52.318985 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-011788ee-d967-4355-96d3-42b8d781e6f9 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:52.319881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-011788ee-d967-4355-96d3-42b8d781e6f9 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:52.320510 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-011788ee-d967-4355-96d3-42b8d781e6f9 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:52.320989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-011788ee-d967-4355-96d3-42b8d781e6f9 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:52.593210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-011788ee-d967-4355-96d3-42b8d781e6f9 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:52.603914 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-011788ee-d967-4355-96d3-42b8d781e6f9 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1319 microversion: 2.1 time: 0.297920 Aug 23 22:29:52.604730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 352/680] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:52 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:52.617539 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:52.617539 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:52.620661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:52.621177 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:52.621614 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:52.622364 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:52.622818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:52.623235 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:52.733870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] HTTP exception thrown: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 is not attached to volume 7135e762-c27b-44c2-9cba-700a7efa015a Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Request method failure captured: Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments/7135e762-c27b-44c2-9cba-700a7efa015a HTTP/1.1 Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVQJ0z24WpzCOb3FakS-Xljk9zxcmyLMujavzvmhioLh5A7YA7tS05VZPNc_dd73AxLfkjQWyTUtL6gyMOF8D4XHBT9VV-i-NnE_Qi6X5oiM2wcr3W8pufr8MLGmh3DgpBmeYyTF6WkWFyOkthiGnUmn6X0Md_-FcfTS9lp9PkY0idU Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 2cfc99aa2ea246fb845d429885ff5209 Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-TestMinimumBasicScenario-1927662373 Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:29:52.747731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2cfc99aa2ea246fb845d429885ff5209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2cfc99aa2ea246fb845d429885ff5209"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2cfc99aa2ea246fb845d429885ff5209"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2cfc99aa2ea246fb845d429885ff5209"}]}] Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-TestMinimumBasicScenario-1927662373 Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 2cfc99aa2ea246fb845d429885ff5209 Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1927662373 Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-TestMinimumBasicScenario-1927662373-project Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: eb81364013af425e9956dd09ceb150e6 Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-TestMinimumBasicScenario-1927662373-project Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:29:52.750733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 is not attached to volume 7135e762-c27b-44c2-9cba-700a7efa015a Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'server_id': 'a30f307e-cf90-4c02-ab66-f16d7bc4b427', 'id': '7135e762-c27b-44c2-9cba-700a7efa015a'} Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7135e762-c27b-44c2-9cba-700a7efa015a. Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:29:52.752906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 is not attached to volume 7135e762-c27b-44c2-9cba-700a7efa015a Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 is not attached to volume 7135e762-c27b-44c2-9cba-700a7efa015a Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:52.755867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Returning 404 to user: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 is not attached to volume 7135e762-c27b-44c2-9cba-700a7efa015a {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:29:52.762321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-021c53b1-7f7b-455b-9cc5-bfd8a0bd0c89 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments/7135e762-c27b-44c2-9cba-700a7efa015a" status: 404 len: 154 microversion: 2.1 time: 0.147232 Aug 23 22:29:52.762321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 353/681] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:29:52 2022] DELETE /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427/os-volume_attachments/7135e762-c27b-44c2-9cba-700a7efa015a => generated 154 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:29:52.817595 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-93a80408-6cb2-42c0-bf66-0498aad630bf req-fa893378-37bc-4628-a55a-a053ab8bd3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd812373-cfc2-4d5e-8230-2e0a72153994", "name": "network-vif-deleted", "tag": "614d514f-5113-4d77-8846-ee45da0b972d"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:52.828241 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-93a80408-6cb2-42c0-bf66-0498aad630bf req-fa893378-37bc-4628-a55a-a053ab8bd3ca service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:52.828560 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-93a80408-6cb2-42c0-bf66-0498aad630bf req-fa893378-37bc-4628-a55a-a053ab8bd3ca service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:52.828830 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-93a80408-6cb2-42c0-bf66-0498aad630bf req-fa893378-37bc-4628-a55a-a053ab8bd3ca service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:52.842622 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-93a80408-6cb2-42c0-bf66-0498aad630bf req-fa893378-37bc-4628-a55a-a053ab8bd3ca service nova] Creating event network-vif-deleted:614d514f-5113-4d77-8846-ee45da0b972d for instance fd812373-cfc2-4d5e-8230-2e0a72153994 on hv-cinder-85032 Aug 23 22:29:52.848666 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-93a80408-6cb2-42c0-bf66-0498aad630bf req-fa893378-37bc-4628-a55a-a053ab8bd3ca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 Aug 23 22:29:52.852412 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 354/682] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:29:52.984886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:52.990729 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:52.997851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:52.997851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:52.998865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:52.999605 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:53.000050 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:53.000473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:53.187090 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:53.205490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:53.209416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:53.211763 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7b65db3d-76da-48f1-bac7-210838b3aa57 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.231508 Aug 23 22:29:53.212872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 355/683] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:29:52 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:29:53.266065 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-732158a7-22b9-4bb0-b3cb-dd1f844404b1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:53.267334 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-732158a7-22b9-4bb0-b3cb-dd1f844404b1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:53.283107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-732158a7-22b9-4bb0-b3cb-dd1f844404b1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:53.283848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-732158a7-22b9-4bb0-b3cb-dd1f844404b1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:53.284233 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-732158a7-22b9-4bb0-b3cb-dd1f844404b1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:53.285254 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-732158a7-22b9-4bb0-b3cb-dd1f844404b1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:53.285731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-732158a7-22b9-4bb0-b3cb-dd1f844404b1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:53.286277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-732158a7-22b9-4bb0-b3cb-dd1f844404b1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:53.430840 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-732158a7-22b9-4bb0-b3cb-dd1f844404b1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:53.439480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-732158a7-22b9-4bb0-b3cb-dd1f844404b1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1322 microversion: 2.1 time: 0.178165 Aug 23 22:29:53.440497 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 356/684] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:53 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:53.628136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-61052575-e85f-42b6-b8eb-06dd0a03b23c tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:53.629415 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-61052575-e85f-42b6-b8eb-06dd0a03b23c tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:53.636000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61052575-e85f-42b6-b8eb-06dd0a03b23c tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:53.636490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61052575-e85f-42b6-b8eb-06dd0a03b23c tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:53.636925 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61052575-e85f-42b6-b8eb-06dd0a03b23c tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:53.637675 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61052575-e85f-42b6-b8eb-06dd0a03b23c tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:53.638318 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61052575-e85f-42b6-b8eb-06dd0a03b23c tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:53.638887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61052575-e85f-42b6-b8eb-06dd0a03b23c tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:53.846703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-61052575-e85f-42b6-b8eb-06dd0a03b23c tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:53.863085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-61052575-e85f-42b6-b8eb-06dd0a03b23c tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1319 microversion: 2.1 time: 0.238911 Aug 23 22:29:53.881550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 357/685] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:53 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:53.977638 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9a7e17ba-6a19-4d91-9e78-dead869ae9f2 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:53.978901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9a7e17ba-6a19-4d91-9e78-dead869ae9f2 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:53.990239 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a7e17ba-6a19-4d91-9e78-dead869ae9f2 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:53.992400 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a7e17ba-6a19-4d91-9e78-dead869ae9f2 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:53.993198 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a7e17ba-6a19-4d91-9e78-dead869ae9f2 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:53.994354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a7e17ba-6a19-4d91-9e78-dead869ae9f2 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:53.995381 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a7e17ba-6a19-4d91-9e78-dead869ae9f2 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:53.996324 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9a7e17ba-6a19-4d91-9e78-dead869ae9f2 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:54.043882 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9a7e17ba-6a19-4d91-9e78-dead869ae9f2 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:29:54.201461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9a7e17ba-6a19-4d91-9e78-dead869ae9f2 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 204 len: 0 microversion: 2.1 time: 0.229038 Aug 23 22:29:54.202400 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 358/686] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:29:53 2022] DELETE /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:29:54.212353 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8f90085c-e523-4cf9-9350-11d7bffa4f23 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:54.213765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8f90085c-e523-4cf9-9350-11d7bffa4f23 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:54.220378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f90085c-e523-4cf9-9350-11d7bffa4f23 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:54.220862 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f90085c-e523-4cf9-9350-11d7bffa4f23 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:54.221545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f90085c-e523-4cf9-9350-11d7bffa4f23 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:54.222426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f90085c-e523-4cf9-9350-11d7bffa4f23 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:54.223561 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f90085c-e523-4cf9-9350-11d7bffa4f23 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:54.224141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f90085c-e523-4cf9-9350-11d7bffa4f23 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:54.412717 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8f90085c-e523-4cf9-9350-11d7bffa4f23 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:54.433594 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8f90085c-e523-4cf9-9350-11d7bffa4f23 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1555 microversion: 2.1 time: 0.225982 Aug 23 22:29:54.434553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 359/687] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:54 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:54.448946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:54.448946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:54.460621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:54.462770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:54.462770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:54.463880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:54.465117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:54.465759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:54.495808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:54.726585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:54.735913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:54.737593 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:54.739625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fd73680d-5be9-4200-bea2-c8c59096e57a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.303793 Aug 23 22:29:54.740204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 360/688] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:29:54 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:29:54.745043 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-78f7430a-f4e1-494d-935f-d0c5765ba176 req-95a3af95-a4fd-4c71-925c-976afef69649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e60237b-94d3-441b-b7d5-ca559d89b007", "tag": "f3cc9f8e-d4bb-4be5-9331-919d7c7999fc"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:54.756773 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-78f7430a-f4e1-494d-935f-d0c5765ba176 req-95a3af95-a4fd-4c71-925c-976afef69649 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:54.757378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-78f7430a-f4e1-494d-935f-d0c5765ba176 req-95a3af95-a4fd-4c71-925c-976afef69649 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:54.757999 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-78f7430a-f4e1-494d-935f-d0c5765ba176 req-95a3af95-a4fd-4c71-925c-976afef69649 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:54.771403 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-78f7430a-f4e1-494d-935f-d0c5765ba176 req-95a3af95-a4fd-4c71-925c-976afef69649 service nova] Creating event network-changed:f3cc9f8e-d4bb-4be5-9331-919d7c7999fc for instance 1e60237b-94d3-441b-b7d5-ca559d89b007 on hv-cinder-85032 Aug 23 22:29:54.777364 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-78f7430a-f4e1-494d-935f-d0c5765ba176 req-95a3af95-a4fd-4c71-925c-976afef69649 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035887 Aug 23 22:29:54.778132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 361/689] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:54.783793 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:54.784524 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:54.792424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:54.792914 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:54.793391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:54.794294 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:54.794859 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:54.795241 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:54.833264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:54.833750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:54.834182 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:54.834635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lazy-loading 'fault' on Instance uuid fd812373-cfc2-4d5e-8230-2e0a72153994 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:29:54.882092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:54.892421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-083c77d5-ae0c-48d0-a431-3fb7f35ab44b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1327 microversion: 2.1 time: 0.112974 Aug 23 22:29:54.893197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 362/690] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:54 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:54.904275 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-db616bab-e8b0-4d67-9170-c885305aa839 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:54.904901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-db616bab-e8b0-4d67-9170-c885305aa839 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:54.913121 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db616bab-e8b0-4d67-9170-c885305aa839 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:54.913875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db616bab-e8b0-4d67-9170-c885305aa839 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:54.914328 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db616bab-e8b0-4d67-9170-c885305aa839 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:54.915197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db616bab-e8b0-4d67-9170-c885305aa839 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:54.915622 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db616bab-e8b0-4d67-9170-c885305aa839 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:54.916015 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db616bab-e8b0-4d67-9170-c885305aa839 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:55.064512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-db616bab-e8b0-4d67-9170-c885305aa839 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:55.073099 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-db616bab-e8b0-4d67-9170-c885305aa839 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1319 microversion: 2.1 time: 0.172873 Aug 23 22:29:55.073692 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 363/691] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:54 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:55.466875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-38b6980a-de6f-4c37-b509-0ba6dd93bfff tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:55.466875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-38b6980a-de6f-4c37-b509-0ba6dd93bfff tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:55.475497 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38b6980a-de6f-4c37-b509-0ba6dd93bfff tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:55.476165 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38b6980a-de6f-4c37-b509-0ba6dd93bfff tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:55.476924 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38b6980a-de6f-4c37-b509-0ba6dd93bfff tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:55.477997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38b6980a-de6f-4c37-b509-0ba6dd93bfff tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:55.478558 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38b6980a-de6f-4c37-b509-0ba6dd93bfff tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:55.479123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-38b6980a-de6f-4c37-b509-0ba6dd93bfff tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:55.632943 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-38b6980a-de6f-4c37-b509-0ba6dd93bfff tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:55.641077 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-38b6980a-de6f-4c37-b509-0ba6dd93bfff tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1555 microversion: 2.1 time: 0.181185 Aug 23 22:29:55.641855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 364/692] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:55 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:55.764910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:55.765637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:55.773127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:55.773784 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:55.774246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:55.775110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:55.775617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:55.776084 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:55.945640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:55.954281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:55.955778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:55.957875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-849bd6ea-9fa5-430c-8696-0047c0ebf708 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.196327 Aug 23 22:29:55.958458 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 365/693] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:29:55 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:29:55.963482 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:55.964249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:55.970989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:55.971475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:55.971909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:55.973418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:55.973418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:55.974189 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:56.008757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:56.009448 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:56.010052 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:56.010618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lazy-loading 'fault' on Instance uuid fd812373-cfc2-4d5e-8230-2e0a72153994 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:29:56.059702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:56.068721 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0e8c5175-bc59-4510-b648-14edaa1489ea tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1327 microversion: 2.1 time: 0.109064 Aug 23 22:29:56.069641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 366/694] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:55 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:56.102896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-19efd7e1-6831-4da6-bfcf-939ce655c553 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:56.103744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-19efd7e1-6831-4da6-bfcf-939ce655c553 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:56.115987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19efd7e1-6831-4da6-bfcf-939ce655c553 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:56.116476 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19efd7e1-6831-4da6-bfcf-939ce655c553 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:56.116909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19efd7e1-6831-4da6-bfcf-939ce655c553 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:56.117654 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19efd7e1-6831-4da6-bfcf-939ce655c553 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:56.118109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19efd7e1-6831-4da6-bfcf-939ce655c553 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:56.118531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-19efd7e1-6831-4da6-bfcf-939ce655c553 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:56.302196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-19efd7e1-6831-4da6-bfcf-939ce655c553 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:56.319075 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-19efd7e1-6831-4da6-bfcf-939ce655c553 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1319 microversion: 2.1 time: 0.221438 Aug 23 22:29:56.319828 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 367/695] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:56 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:29:56.413199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-11bc8e37-0f9c-41f4-9ee2-cab00c1dde80 req-ab66e37b-3d96-4b9d-84ef-96fcde62ab08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b697da-19f2-459e-a57e-e386523e4bcf", "name": "network-vif-unplugged", "status": "completed", "tag": "5867c0e1-ac00-4c87-bd75-9ca953635248"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:56.424491 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-11bc8e37-0f9c-41f4-9ee2-cab00c1dde80 req-ab66e37b-3d96-4b9d-84ef-96fcde62ab08 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:56.425037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-11bc8e37-0f9c-41f4-9ee2-cab00c1dde80 req-ab66e37b-3d96-4b9d-84ef-96fcde62ab08 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:56.425441 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-11bc8e37-0f9c-41f4-9ee2-cab00c1dde80 req-ab66e37b-3d96-4b9d-84ef-96fcde62ab08 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:56.438530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-11bc8e37-0f9c-41f4-9ee2-cab00c1dde80 req-ab66e37b-3d96-4b9d-84ef-96fcde62ab08 service nova] Creating event network-vif-unplugged:5867c0e1-ac00-4c87-bd75-9ca953635248 for instance 80b697da-19f2-459e-a57e-e386523e4bcf on hv-cinder-85032 Aug 23 22:29:56.444506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-11bc8e37-0f9c-41f4-9ee2-cab00c1dde80 req-ab66e37b-3d96-4b9d-84ef-96fcde62ab08 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038343 Aug 23 22:29:56.445151 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 368/696] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:56.666263 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c840bbf6-6d07-4005-9339-e0c6a53e6f98 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:56.667142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c840bbf6-6d07-4005-9339-e0c6a53e6f98 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:56.674157 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c840bbf6-6d07-4005-9339-e0c6a53e6f98 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:56.674696 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c840bbf6-6d07-4005-9339-e0c6a53e6f98 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:56.675174 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c840bbf6-6d07-4005-9339-e0c6a53e6f98 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:56.676554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c840bbf6-6d07-4005-9339-e0c6a53e6f98 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:56.677356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c840bbf6-6d07-4005-9339-e0c6a53e6f98 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:56.677954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c840bbf6-6d07-4005-9339-e0c6a53e6f98 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:56.860793 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c840bbf6-6d07-4005-9339-e0c6a53e6f98 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:56.871854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c840bbf6-6d07-4005-9339-e0c6a53e6f98 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1555 microversion: 2.1 time: 0.212159 Aug 23 22:29:56.872446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 369/697] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:56 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:56.989362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:56.990103 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:57.030124 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:57.031303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:57.033669 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:57.039379 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:57.040284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:57.041130 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:57.088792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:57.364154 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:57.373469 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:57.375110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:57.376367 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-467f8455-794c-46b2-9f7e-a245d6a1ed1d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1722 microversion: 2.20 time: 0.395219 Aug 23 22:29:57.377390 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 370/698] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:29:56 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1722 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:29:57.385567 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:57.386708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:57.398031 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:57.400197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:57.400197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:57.400655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:57.401545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:57.402095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:57.444504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=8 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:57.449457 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:57.449949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:57.450390 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:57.450845 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lazy-loading 'fault' on Instance uuid fd812373-cfc2-4d5e-8230-2e0a72153994 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:29:57.533174 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:57.545842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-11ce8ae2-4c10-4b24-9e41-b9dfaeab5132 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 200 len: 1327 microversion: 2.1 time: 0.166833 Aug 23 22:29:57.554266 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 371/699] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:57 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 1327 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:57.571448 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bed892d5-43a2-459c-b07a-6a0a2bbe6fef tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:57.572908 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bed892d5-43a2-459c-b07a-6a0a2bbe6fef tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:57.580406 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bed892d5-43a2-459c-b07a-6a0a2bbe6fef tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:57.581015 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bed892d5-43a2-459c-b07a-6a0a2bbe6fef tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:57.581582 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bed892d5-43a2-459c-b07a-6a0a2bbe6fef tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:57.583130 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bed892d5-43a2-459c-b07a-6a0a2bbe6fef tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:57.583622 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bed892d5-43a2-459c-b07a-6a0a2bbe6fef tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:57.584108 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bed892d5-43a2-459c-b07a-6a0a2bbe6fef tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:58.487536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-bed892d5-43a2-459c-b07a-6a0a2bbe6fef tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:58.504298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bed892d5-43a2-459c-b07a-6a0a2bbe6fef tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1319 microversion: 2.1 time: 0.947823 Aug 23 22:29:58.504892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 372/700] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:57 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1319 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:58.509926 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5ebd4dc5-8164-4bb4-97eb-74efb9bbad88 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:58.510639 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5ebd4dc5-8164-4bb4-97eb-74efb9bbad88 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:58.517215 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ebd4dc5-8164-4bb4-97eb-74efb9bbad88 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:58.518001 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ebd4dc5-8164-4bb4-97eb-74efb9bbad88 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:58.518749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ebd4dc5-8164-4bb4-97eb-74efb9bbad88 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:58.519542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ebd4dc5-8164-4bb4-97eb-74efb9bbad88 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:58.520009 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ebd4dc5-8164-4bb4-97eb-74efb9bbad88 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:58.520463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ebd4dc5-8164-4bb4-97eb-74efb9bbad88 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:58.913555 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5ebd4dc5-8164-4bb4-97eb-74efb9bbad88 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:58.921831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5ebd4dc5-8164-4bb4-97eb-74efb9bbad88 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1555 microversion: 2.1 time: 0.415659 Aug 23 22:29:58.922441 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 373/701] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:58 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1555 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:58.928595 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:58.929298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:58.935791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:58.936466 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:58.937293 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:58.937671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:58.938227 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:58.938637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:59.044948 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:59.054556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:59.056701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:59.057901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7db3f83d-e084-4617-908e-7192b68f9b12 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1654 microversion: 2.20 time: 0.134551 Aug 23 22:29:59.058877 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 374/702] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:29:58 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1654 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:29:59.063400 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:59.064007 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:59.070422 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:59.070997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:59.071483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:59.072203 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:59.072764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:59.073246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:59.092424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] HTTP exception thrown: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Request method failure captured: Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 HTTP/1.1 Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOpFgR8mEb7G4nPjwgWgf9Ai_EcubfiXK0fp7E0AxsycfW_wrI5dCjhPBwlTsfK5sjiwhwv3KE6XQN3BeQcrn4Shwud96iEsoMi-G_DBSmMnNJYD90nR0AMhzKQfkDUisFCkRvrpEpwaB0X4ddR3kjPWoPJWveaMf6xzD-M_d8iesw Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:29:59.093806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a297ef598b76404b86e9350e120b86c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}] Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: e720fd25d54b4dc6b3387ea762d7e4ae Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:29:59.096634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'fd812373-cfc2-4d5e-8230-2e0a72153994'} Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:29:59.099024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:29:59.100513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:29:59.101997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Returning 404 to user: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:29:59.101997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cddb6eb4-fb61-4620-b8dc-0a5350f6fd92 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 404 len: 111 microversion: 2.1 time: 0.035750 Aug 23 22:29:59.101997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 375/703] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:59 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:29:59.106064 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3f7e7f84-a764-46a8-a9ac-3170efa7c21a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '.version_select at 0x7f902c1385e0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:59.129280 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3f7e7f84-a764-46a8-a9ac-3170efa7c21a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547123866" status: 202 len: 0 microversion: 2.1 time: 0.026780 Aug 23 22:29:59.130198 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 376/704] 10.222.0.88 () {58 vars in 1218 bytes} [Tue Aug 23 22:29:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547123866 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:29:59.423054 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-54644387-91a2-410e-82fe-096e64b4271e req-e64dc0ec-747d-4969-814e-7d2544acf87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b697da-19f2-459e-a57e-e386523e4bcf", "name": "network-vif-deleted", "tag": "5867c0e1-ac00-4c87-bd75-9ca953635248"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:29:59.452772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-54644387-91a2-410e-82fe-096e64b4271e req-e64dc0ec-747d-4969-814e-7d2544acf87d service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:59.454737 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-54644387-91a2-410e-82fe-096e64b4271e req-e64dc0ec-747d-4969-814e-7d2544acf87d service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:59.455809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-54644387-91a2-410e-82fe-096e64b4271e req-e64dc0ec-747d-4969-814e-7d2544acf87d service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:59.517833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-54644387-91a2-410e-82fe-096e64b4271e req-e64dc0ec-747d-4969-814e-7d2544acf87d service nova] Creating event network-vif-deleted:5867c0e1-ac00-4c87-bd75-9ca953635248 for instance 80b697da-19f2-459e-a57e-e386523e4bcf on hv-cinder-85032 Aug 23 22:29:59.530284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-54644387-91a2-410e-82fe-096e64b4271e req-e64dc0ec-747d-4969-814e-7d2544acf87d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120484 Aug 23 22:29:59.531196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 377/705] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:29:59.560194 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-76ac47fe-c791-4ee2-86f5-189c4b7fd0b6 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:59.561416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-76ac47fe-c791-4ee2-86f5-189c4b7fd0b6 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:29:59.575625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76ac47fe-c791-4ee2-86f5-189c4b7fd0b6 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:59.576616 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76ac47fe-c791-4ee2-86f5-189c4b7fd0b6 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:59.577785 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76ac47fe-c791-4ee2-86f5-189c4b7fd0b6 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:59.579704 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76ac47fe-c791-4ee2-86f5-189c4b7fd0b6 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:29:59.580781 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76ac47fe-c791-4ee2-86f5-189c4b7fd0b6 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:29:59.582421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76ac47fe-c791-4ee2-86f5-189c4b7fd0b6 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:29:59.971795 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-76ac47fe-c791-4ee2-86f5-189c4b7fd0b6 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:29:59.982816 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-76ac47fe-c791-4ee2-86f5-189c4b7fd0b6 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1319 microversion: 2.1 time: 0.448919 Aug 23 22:29:59.983898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 378/706] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:59 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:29:59.993823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:29:59.994990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:00.013708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:00.014601 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:00.015374 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:00.016673 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:00.017545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:00.018432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:00.095253 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:00.096354 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:00.098192 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:00.099518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lazy-loading 'fault' on Instance uuid a30f307e-cf90-4c02-ab66-f16d7bc4b427 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:30:00.106672 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=100 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:00.185013 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb81364013af425e9956dd09ceb150e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfc99aa2ea246fb845d429885ff5209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:00.209747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fcf08ec7-a2c2-42ae-a1ce-fa28c97d23ca tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 200 len: 1349 microversion: 2.1 time: 0.224196 Aug 23 22:30:00.210954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 379/707] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:29:59 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 1349 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:00.217112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:00.217743 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:00.226722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:00.227294 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:00.227850 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:00.229445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:00.230065 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:00.230542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:00.293537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:00.294041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:00.294520 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:00.295013 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lazy-loading 'fault' on Instance uuid 80b697da-19f2-459e-a57e-e386523e4bcf {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:30:00.382724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:00.402208 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:00.405195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:00.406706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ebe0e1fb-560f-4ef7-93de-a5b4e4ced3c3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 200 len: 1371 microversion: 2.20 time: 0.194539 Aug 23 22:30:00.407313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 380/708] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:00 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:00.549658 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-16f82939-51c9-493c-9c32-ca755af2eef5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'create', calling method: .version_select at 0x7f901fff70d0>, body: {"keypair": {"name": "tempest-keypair-933694992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW+lzkx4VU0bYfhmucGtQqIR33bI72sPdO0+Kphgzhl5ScSS/qKRJODTjWi3KB01Ra+0akwlqdlgW2Zk5mj5vus8HLq2MghtzIsq5kvZ9BP50/2xdLqTdrRoqgdNkUibg=="}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:00.603990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-16f82939-51c9-493c-9c32-ca755af2eef5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Getting quotas for project a297ef598b76404b86e9350e120b86c9. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:30:00.620028 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-16f82939-51c9-493c-9c32-ca755af2eef5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Getting quotas for user e720fd25d54b4dc6b3387ea762d7e4ae and project a297ef598b76404b86e9350e120b86c9. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:30:00.685026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:00.728390 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-16f82939-51c9-493c-9c32-ca755af2eef5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.188487 Aug 23 22:30:00.730000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 381/709] 10.222.0.88 () {60 vars in 1159 bytes} [Tue Aug 23 22:30:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:01.012114 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-61c1b24c-499b-4f21-a9eb-79d36255f7fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:01.012872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-61c1b24c-499b-4f21-a9eb-79d36255f7fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:01.024438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61c1b24c-499b-4f21-a9eb-79d36255f7fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:01.025552 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61c1b24c-499b-4f21-a9eb-79d36255f7fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:01.026964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61c1b24c-499b-4f21-a9eb-79d36255f7fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:01.028089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61c1b24c-499b-4f21-a9eb-79d36255f7fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:01.029373 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61c1b24c-499b-4f21-a9eb-79d36255f7fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:01.030098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61c1b24c-499b-4f21-a9eb-79d36255f7fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:01.307971 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-61c1b24c-499b-4f21-a9eb-79d36255f7fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:01.340576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-61c1b24c-499b-4f21-a9eb-79d36255f7fd tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1319 microversion: 2.1 time: 0.333303 Aug 23 22:30:01.341783 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 382/710] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:01 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:01.347882 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:01.348833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] [instance: a30f307e-cf90-4c02-ab66-f16d7bc4b427] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:01.364135 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:01.365316 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:01.365762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:01.368929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:01.369789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:01.370214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:01.396087 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] HTTP exception thrown: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 could not be found. Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Request method failure captured: Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 HTTP/1.1 Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVQJ0z24WpzCOb3FakS-Xljk9zxcmyLMujavzvmhioLh5A7YA7tS05VZPNc_dd73AxLfkjQWyTUtL6gyMOF8D4XHBT9VV-i-NnE_Qi6X5oiM2wcr3W8pufr8MLGmh3DgpBmeYyTF6WkWFyOkthiGnUmn6X0Md_-FcfTS9lp9PkY0idU Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 2cfc99aa2ea246fb845d429885ff5209 Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-TestMinimumBasicScenario-1927662373 Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:30:01.397769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2cfc99aa2ea246fb845d429885ff5209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2cfc99aa2ea246fb845d429885ff5209"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2cfc99aa2ea246fb845d429885ff5209"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2cfc99aa2ea246fb845d429885ff5209"}]}] Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-TestMinimumBasicScenario-1927662373 Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 2cfc99aa2ea246fb845d429885ff5209 Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1927662373 Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-TestMinimumBasicScenario-1927662373-project Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: eb81364013af425e9956dd09ceb150e6 Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-TestMinimumBasicScenario-1927662373-project Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 could not be found. Aug 23 22:30:01.400289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'a30f307e-cf90-4c02-ab66-f16d7bc4b427'} Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 could not be found. Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:30:01.401870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 could not be found. Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 could not be found. Aug 23 22:30:01.404242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:01.405633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Returning 404 to user: Instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:30:01.405633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-30da691b-c869-4543-925e-859a5df0e871 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427" status: 404 len: 111 microversion: 2.1 time: 0.058722 Aug 23 22:30:01.408021 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 383/711] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:01 2022] GET /compute/v2.1/servers/a30f307e-cf90-4c02-ab66-f16d7bc4b427 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:30:01.420121 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-898d0bd0-b636-464e-b85f-8a32bd99da10 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] Calling method '.version_select at 0x7f901fe6e310>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:01.446721 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-898d0bd0-b636-464e-b85f-8a32bd99da10 tempest-TestMinimumBasicScenario-1927662373 tempest-TestMinimumBasicScenario-1927662373-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2063591735" status: 202 len: 0 microversion: 2.1 time: 0.031265 Aug 23 22:30:01.447863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 384/712] 10.222.0.88 () {58 vars in 1272 bytes} [Tue Aug 23 22:30:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2063591735 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:30:01.452924 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:01.454195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:01.463013 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:01.463963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:01.464724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:01.465863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:01.466565 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:01.467471 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:01.493753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] HTTP exception thrown: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Request method failure captured: Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf HTTP/1.1 Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOh2yvxaj-wiKmzJBWrXmHZzvMz3Op7M2I-YsvNdLZbHaAwQXvCxy4iZMuSOXr6Nn8ZjtDDWGLP4aud8q3Rfu0xBvAkS8CXTsDcT5K-AeXP0RgESEpA0qKnJ5plz5ySC2aItD9qdBcjnl9WUNXaCJDznJpMq8FtjMpspKEBUOIRQ5Y Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:30:01.495478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}] Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: c06cd43d533f4621b0a69dbb0ef22dc4 Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:30:01.497463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '80b697da-19f2-459e-a57e-e386523e4bcf'} Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:30:01.498490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:30:01.499821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:01.505181 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Returning 404 to user: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:30:01.506373 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1fb084a2-89e8-4c33-9479-bf018477f523 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 404 len: 111 microversion: 2.20 time: 0.057345 Aug 23 22:30:01.507153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 385/713] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:01 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:30:01.520286 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a238959f-085f-436b-b8d5-f7b2a62dc7f4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '.version_select at 0x7f901ff6cc10>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:01.553611 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a238959f-085f-436b-b8d5-f7b2a62dc7f4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1424048073" status: 204 len: 0 microversion: 2.20 time: 0.039715 Aug 23 22:30:01.555960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 386/714] 10.222.0.88 () {60 vars in 1262 bytes} [Tue Aug 23 22:30:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1424048073 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 22:30:01.562881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-82537a25-453b-4732-a99f-2385e623174f req-e1cb005a-a453-40e0-8e85-87e8fffa72e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30f307e-cf90-4c02-ab66-f16d7bc4b427", "name": "network-vif-deleted", "tag": "e9f61e27-4256-4ba2-904d-a608368e989b"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:01.581037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-82537a25-453b-4732-a99f-2385e623174f req-e1cb005a-a453-40e0-8e85-87e8fffa72e3 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:01.583223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-82537a25-453b-4732-a99f-2385e623174f req-e1cb005a-a453-40e0-8e85-87e8fffa72e3 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:01.583223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-82537a25-453b-4732-a99f-2385e623174f req-e1cb005a-a453-40e0-8e85-87e8fffa72e3 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:01.600719 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-82537a25-453b-4732-a99f-2385e623174f req-e1cb005a-a453-40e0-8e85-87e8fffa72e3 service nova] Creating event network-vif-deleted:e9f61e27-4256-4ba2-904d-a608368e989b for instance a30f307e-cf90-4c02-ab66-f16d7bc4b427 on hv-cinder-85032 Aug 23 22:30:01.607243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-82537a25-453b-4732-a99f-2385e623174f req-e1cb005a-a453-40e0-8e85-87e8fffa72e3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049032 Aug 23 22:30:01.607979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 387/715] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:02.371363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-35bec788-a086-4413-badb-fa1cc5018c63 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:02.373239 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-35bec788-a086-4413-badb-fa1cc5018c63 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:02.387979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35bec788-a086-4413-badb-fa1cc5018c63 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:02.389611 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35bec788-a086-4413-badb-fa1cc5018c63 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:02.390988 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35bec788-a086-4413-badb-fa1cc5018c63 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:02.392587 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35bec788-a086-4413-badb-fa1cc5018c63 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:02.394108 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35bec788-a086-4413-badb-fa1cc5018c63 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:02.395576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-35bec788-a086-4413-badb-fa1cc5018c63 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:02.778081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-35bec788-a086-4413-badb-fa1cc5018c63 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:02.793479 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-35bec788-a086-4413-badb-fa1cc5018c63 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1319 microversion: 2.1 time: 0.427581 Aug 23 22:30:02.796306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 388/716] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:02 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:30:02.865635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ec46cc20-dc27-4c42-b374-7cb2bb6d6856 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Action: 'create', calling method: .version_select at 0x7f901ff6cca0>, body: {"keypair": {"name": "tempest-keypair-751245124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfb/8l72OKQFh8xZCnzjL+mdGI7YQF73m7kie/DclDkMWqzoUBcHvOmpm1CyP+FAkaDiA7Knc0ZWXcYYcJtE4wTt8g1jfYc1iOpJBsrWSvx+/7I+/R+gsh4+6ndQkB7+Q=="}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:02.889723 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-ec46cc20-dc27-4c42-b374-7cb2bb6d6856 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Getting quotas for project 8be30316f0b745d783ec96bc983b2cb1. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:30:02.895116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-ec46cc20-dc27-4c42-b374-7cb2bb6d6856 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Getting quotas for user c06cd43d533f4621b0a69dbb0ef22dc4 and project 8be30316f0b745d783ec96bc983b2cb1. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:30:02.922901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ec46cc20-dc27-4c42-b374-7cb2bb6d6856 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.062403 Aug 23 22:30:02.923683 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 389/717] 10.222.0.88 () {62 vars in 1200 bytes} [Tue Aug 23 22:30:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 22:30:03.234505 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-74647239", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b506c549-1d3c-4779-b5de-b5a4c62df2b1"}], "security_groups": [{"name": "tempest-securitygroup--252070664"}], "key_name": "tempest-keypair-933694992", "user_data": "}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:03.732417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] validate_networks() for [('b506c549-1d3c-4779-b5de-b5a4c62df2b1', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:30:04.859061 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:30:04.860209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:30:04.860950 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:30:04.862129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:30:04.864281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:30:04.876663 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:04.878045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:04.879584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:04.880757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:04.881532 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:04.882194 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:04.907952 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Getting quotas for project a297ef598b76404b86e9350e120b86c9. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:30:04.914336 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Getting quotas for user e720fd25d54b4dc6b3387ea762d7e4ae and project a297ef598b76404b86e9350e120b86c9. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:30:04.930356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:30:04.936061 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:30:05.033686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0030f1bf-1616-41dd-af9b-455cbe73cdf7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.804924 Aug 23 22:30:05.034444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 390/718] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:30:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:30:05.040242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-731a28f2-c315-4dd5-aebf-2794962cd1ab tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:05.041250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-731a28f2-c315-4dd5-aebf-2794962cd1ab tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:05.055719 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731a28f2-c315-4dd5-aebf-2794962cd1ab tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:05.056310 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731a28f2-c315-4dd5-aebf-2794962cd1ab tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:05.056757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731a28f2-c315-4dd5-aebf-2794962cd1ab tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:05.057653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731a28f2-c315-4dd5-aebf-2794962cd1ab tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:05.058110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731a28f2-c315-4dd5-aebf-2794962cd1ab tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:05.058571 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731a28f2-c315-4dd5-aebf-2794962cd1ab tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:05.402315 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-731a28f2-c315-4dd5-aebf-2794962cd1ab tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:05.415837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-731a28f2-c315-4dd5-aebf-2794962cd1ab tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1319 microversion: 2.1 time: 0.379303 Aug 23 22:30:05.416873 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 391/719] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:05 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:05.423805 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-09529dd4-bfb6-40f6-88c4-b00ea251d7e5 req-cb92b878-c1ab-4ff6-b45d-48b8aba37f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e60237b-94d3-441b-b7d5-ca559d89b007", "name": "network-vif-plugged", "status": "completed", "tag": "f3cc9f8e-d4bb-4be5-9331-919d7c7999fc"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:05.445600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-09529dd4-bfb6-40f6-88c4-b00ea251d7e5 req-cb92b878-c1ab-4ff6-b45d-48b8aba37f4c service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:05.446280 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-09529dd4-bfb6-40f6-88c4-b00ea251d7e5 req-cb92b878-c1ab-4ff6-b45d-48b8aba37f4c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:05.447001 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-09529dd4-bfb6-40f6-88c4-b00ea251d7e5 req-cb92b878-c1ab-4ff6-b45d-48b8aba37f4c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:05.478197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-09529dd4-bfb6-40f6-88c4-b00ea251d7e5 req-cb92b878-c1ab-4ff6-b45d-48b8aba37f4c service nova] Creating event network-vif-plugged:f3cc9f8e-d4bb-4be5-9331-919d7c7999fc for instance 1e60237b-94d3-441b-b7d5-ca559d89b007 on hv-cinder-85032 Aug 23 22:30:05.499399 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-09529dd4-bfb6-40f6-88c4-b00ea251d7e5 req-cb92b878-c1ab-4ff6-b45d-48b8aba37f4c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068982 Aug 23 22:30:05.500618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 392/720] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:05.510928 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-de89dc14-761a-446b-b503-b056328994bf tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:05.512270 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-de89dc14-761a-446b-b503-b056328994bf tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:05.654038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-de89dc14-761a-446b-b503-b056328994bf tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:05.677374 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-de89dc14-761a-446b-b503-b056328994bf tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1235 microversion: 2.1 time: 0.171056 Aug 23 22:30:05.693087 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 393/721] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:05 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1235 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:05.693087 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1231063127", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88a201d9-4618-46e2-8cf5-795d8dfe4e5c"}], "security_groups": [{"name": "tempest-securitygroup--2045734416"}], "key_name": "tempest-keypair-751245124", "user_data": "}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:06.103814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] validate_networks() for [('88a201d9-4618-46e2-8cf5-795d8dfe4e5c', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:30:06.987399 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:30:06.988062 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:30:06.988803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:30:06.994497 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:30:06.995089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:30:07.009640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:07.010119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:07.010826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:07.012306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:07.012767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:07.013228 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:07.046903 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Getting quotas for project 8be30316f0b745d783ec96bc983b2cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:30:07.056232 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Getting quotas for user c06cd43d533f4621b0a69dbb0ef22dc4 and project 8be30316f0b745d783ec96bc983b2cb1. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:30:07.088022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:30:07.093542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:30:07.185099 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a1bfc761-65f9-4bcb-af97-d9f785071add tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.504385 Aug 23 22:30:07.187790 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 394/722] 10.222.0.88 () {62 vars in 1188 bytes} [Tue Aug 23 22:30:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 22:30:07.195437 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0afb8192-b53c-4d74-bb0c-4270f5490cea tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:07.196331 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0afb8192-b53c-4d74-bb0c-4270f5490cea tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:07.204907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0afb8192-b53c-4d74-bb0c-4270f5490cea tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:07.205884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0afb8192-b53c-4d74-bb0c-4270f5490cea tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:07.207320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0afb8192-b53c-4d74-bb0c-4270f5490cea tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:07.208541 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0afb8192-b53c-4d74-bb0c-4270f5490cea tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:07.209239 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0afb8192-b53c-4d74-bb0c-4270f5490cea tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:07.209874 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0afb8192-b53c-4d74-bb0c-4270f5490cea tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:07.475416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0afb8192-b53c-4d74-bb0c-4270f5490cea tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:07.496992 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0afb8192-b53c-4d74-bb0c-4270f5490cea tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1319 microversion: 2.1 time: 0.306813 Aug 23 22:30:07.509307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 395/723] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:07 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:07.520077 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a29c344c-37a1-44ff-9b90-3bfbbdd11075 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:07.521634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a29c344c-37a1-44ff-9b90-3bfbbdd11075 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:07.534249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a29c344c-37a1-44ff-9b90-3bfbbdd11075 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:07.536017 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a29c344c-37a1-44ff-9b90-3bfbbdd11075 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:07.537228 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a29c344c-37a1-44ff-9b90-3bfbbdd11075 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:07.538903 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a29c344c-37a1-44ff-9b90-3bfbbdd11075 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:07.540343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a29c344c-37a1-44ff-9b90-3bfbbdd11075 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:07.541508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a29c344c-37a1-44ff-9b90-3bfbbdd11075 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:07.706225 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a29c344c-37a1-44ff-9b90-3bfbbdd11075 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:07.730898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a29c344c-37a1-44ff-9b90-3bfbbdd11075 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1287 microversion: 2.1 time: 0.217946 Aug 23 22:30:07.731662 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 396/724] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:07 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1287 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:07.789263 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ff403df8-7b31-4c80-be52-e656662fcbeb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:07.790713 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ff403df8-7b31-4c80-be52-e656662fcbeb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:07.885172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ff403df8-7b31-4c80-be52-e656662fcbeb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:07.912802 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ff403df8-7b31-4c80-be52-e656662fcbeb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:07.921890 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ff403df8-7b31-4c80-be52-e656662fcbeb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:07.924075 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ff403df8-7b31-4c80-be52-e656662fcbeb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1281 microversion: 2.20 time: 0.176930 Aug 23 22:30:07.926813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 397/725] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:07 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1281 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:08.539831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-aa4616b4-b8f8-4857-9ce0-cf66a7fbac83 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:08.541842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-aa4616b4-b8f8-4857-9ce0-cf66a7fbac83 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:08.562376 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa4616b4-b8f8-4857-9ce0-cf66a7fbac83 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:08.564501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa4616b4-b8f8-4857-9ce0-cf66a7fbac83 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:08.565640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa4616b4-b8f8-4857-9ce0-cf66a7fbac83 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:08.568703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa4616b4-b8f8-4857-9ce0-cf66a7fbac83 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:08.569446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa4616b4-b8f8-4857-9ce0-cf66a7fbac83 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:08.570145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa4616b4-b8f8-4857-9ce0-cf66a7fbac83 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:08.870322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-aa4616b4-b8f8-4857-9ce0-cf66a7fbac83 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:08.885377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-aa4616b4-b8f8-4857-9ce0-cf66a7fbac83 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1506 microversion: 2.1 time: 0.348946 Aug 23 22:30:08.886842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 398/726] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:08 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:08.896705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fc34c742-3b08-432b-8bca-f45a073b6da8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:08.898502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fc34c742-3b08-432b-8bca-f45a073b6da8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:08.923139 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fc34c742-3b08-432b-8bca-f45a073b6da8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:08.923911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fc34c742-3b08-432b-8bca-f45a073b6da8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:08.924485 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fc34c742-3b08-432b-8bca-f45a073b6da8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:08.926031 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fc34c742-3b08-432b-8bca-f45a073b6da8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:08.926518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fc34c742-3b08-432b-8bca-f45a073b6da8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:08.927111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fc34c742-3b08-432b-8bca-f45a073b6da8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:09.062131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fc34c742-3b08-432b-8bca-f45a073b6da8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:09.077095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fc34c742-3b08-432b-8bca-f45a073b6da8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1293 microversion: 2.1 time: 0.188169 Aug 23 22:30:09.081120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 399/727] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:08 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1293 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:09.085202 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-790f9f57-8d1a-40ba-ab27-c9670d82a539 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "294a79ca-4acd-490d-97ce-97c4f82c9c54", "device": "/dev/sdb"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:09.100866 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-790f9f57-8d1a-40ba-ab27-c9670d82a539 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:09.118071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-790f9f57-8d1a-40ba-ab27-c9670d82a539 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:09.123703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-790f9f57-8d1a-40ba-ab27-c9670d82a539 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:09.125249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-790f9f57-8d1a-40ba-ab27-c9670d82a539 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:09.126163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-790f9f57-8d1a-40ba-ab27-c9670d82a539 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:09.126718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-790f9f57-8d1a-40ba-ab27-c9670d82a539 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:09.127451 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-790f9f57-8d1a-40ba-ab27-c9670d82a539 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:09.822657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-790f9f57-8d1a-40ba-ab27-c9670d82a539 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "POST /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.742748 Aug 23 22:30:09.823800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 400/728] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:30:09 2022] POST /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007/os-volume_attachments => generated 194 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:09.842193 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:09.844246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:09.862538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:09.864546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:09.865751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:09.867469 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:09.868816 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:09.869791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:10.360443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:10.373709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:10.375617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:10.376998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-58af156a-cae6-4d82-871d-1d3e69e203a2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1339 microversion: 2.20 time: 0.551872 Aug 23 22:30:10.389173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 401/729] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:09 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1339 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:10.389173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1bcfc226-c6b0-4db9-9fd4-b1fd8beae2cd tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:10.389173 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1bcfc226-c6b0-4db9-9fd4-b1fd8beae2cd tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:10.395646 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bcfc226-c6b0-4db9-9fd4-b1fd8beae2cd tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:10.396307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bcfc226-c6b0-4db9-9fd4-b1fd8beae2cd tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:10.397022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bcfc226-c6b0-4db9-9fd4-b1fd8beae2cd tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:10.398076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bcfc226-c6b0-4db9-9fd4-b1fd8beae2cd tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:10.398656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bcfc226-c6b0-4db9-9fd4-b1fd8beae2cd tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:10.399187 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bcfc226-c6b0-4db9-9fd4-b1fd8beae2cd tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:10.871142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1bcfc226-c6b0-4db9-9fd4-b1fd8beae2cd tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:10.883598 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1bcfc226-c6b0-4db9-9fd4-b1fd8beae2cd tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.503991 Aug 23 22:30:10.884455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 402/730] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:10 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:11.421927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:11.423023 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:11.433501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:11.434251 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:11.434831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:11.435718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:11.436435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:11.436990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:11.598203 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:11.616070 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:11.619521 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:11.621472 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-54a3949e-c4af-4cfe-8b0e-8f6cb4e427da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1339 microversion: 2.20 time: 0.207034 Aug 23 22:30:11.622143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 403/731] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:11 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1339 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:11.914164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d44e00ac-e16d-414d-bcc2-988e01ce52a7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:11.915347 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d44e00ac-e16d-414d-bcc2-988e01ce52a7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:11.928520 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d44e00ac-e16d-414d-bcc2-988e01ce52a7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:11.929455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d44e00ac-e16d-414d-bcc2-988e01ce52a7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:11.930269 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d44e00ac-e16d-414d-bcc2-988e01ce52a7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:11.931556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d44e00ac-e16d-414d-bcc2-988e01ce52a7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:11.932705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d44e00ac-e16d-414d-bcc2-988e01ce52a7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:11.933491 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d44e00ac-e16d-414d-bcc2-988e01ce52a7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:11.965881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:12.480021 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d44e00ac-e16d-414d-bcc2-988e01ce52a7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:12.498588 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d44e00ac-e16d-414d-bcc2-988e01ce52a7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.592154 Aug 23 22:30:12.499684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 404/732] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:11 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:12.659511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:12.660883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:12.669440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:12.669957 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:12.670403 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:12.671153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:12.671656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:12.672077 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:13.789419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:13.820569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:13.823861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:13.826533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d42f57ef-a184-4ee2-b122-5365917b8fda tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 1.171596 Aug 23 22:30:13.827584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 405/733] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:12 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:30:13.838107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-083a01d4-3f2e-43ca-929a-81f6852c277d req-77928739-8901-4c6b-a081-d46379009fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb06a53f-d4f0-465e-9c75-8d72e44c0640", "tag": "edad9bc4-ba17-4879-b9ef-138943b74c95"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:13.847536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=90,nova_api:DELETE=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:13.856701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-083a01d4-3f2e-43ca-929a-81f6852c277d req-77928739-8901-4c6b-a081-d46379009fcd service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:13.857394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-083a01d4-3f2e-43ca-929a-81f6852c277d req-77928739-8901-4c6b-a081-d46379009fcd service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:13.857898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-083a01d4-3f2e-43ca-929a-81f6852c277d req-77928739-8901-4c6b-a081-d46379009fcd service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:13.884953 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-083a01d4-3f2e-43ca-929a-81f6852c277d req-77928739-8901-4c6b-a081-d46379009fcd service nova] Creating event network-changed:edad9bc4-ba17-4879-b9ef-138943b74c95 for instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 on hv-cinder-85032 Aug 23 22:30:13.892942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-083a01d4-3f2e-43ca-929a-81f6852c277d req-77928739-8901-4c6b-a081-d46379009fcd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063166 Aug 23 22:30:13.895423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 406/734] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:13.902467 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-36202fb1-4c7a-4984-aac6-a35fa9597960 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:13.903506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-36202fb1-4c7a-4984-aac6-a35fa9597960 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:13.940094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36202fb1-4c7a-4984-aac6-a35fa9597960 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:13.940716 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36202fb1-4c7a-4984-aac6-a35fa9597960 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:13.942306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36202fb1-4c7a-4984-aac6-a35fa9597960 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:13.943871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36202fb1-4c7a-4984-aac6-a35fa9597960 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:13.944380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36202fb1-4c7a-4984-aac6-a35fa9597960 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:13.944875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36202fb1-4c7a-4984-aac6-a35fa9597960 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:14.855674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-36202fb1-4c7a-4984-aac6-a35fa9597960 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:14.869425 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-36202fb1-4c7a-4984-aac6-a35fa9597960 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.972035 Aug 23 22:30:14.870432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 407/735] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:13 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:14.889356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:14.889982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:14.897837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:14.898392 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:14.899236 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:14.899766 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:14.900269 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:14.900844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:15.453753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:15.477008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:15.480517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:15.483668 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1653577d-348e-4a9d-90bd-243a37624d81 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.597872 Aug 23 22:30:15.485110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 408/736] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:14 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:15.908749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9f2ae22c-0799-4c53-96a9-8a6036275e94 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:15.911693 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9f2ae22c-0799-4c53-96a9-8a6036275e94 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:15.924060 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f2ae22c-0799-4c53-96a9-8a6036275e94 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:15.925547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f2ae22c-0799-4c53-96a9-8a6036275e94 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:15.926632 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f2ae22c-0799-4c53-96a9-8a6036275e94 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:15.928902 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f2ae22c-0799-4c53-96a9-8a6036275e94 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:15.930257 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f2ae22c-0799-4c53-96a9-8a6036275e94 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:15.931019 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9f2ae22c-0799-4c53-96a9-8a6036275e94 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:16.194970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9f2ae22c-0799-4c53-96a9-8a6036275e94 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:16.203939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9f2ae22c-0799-4c53-96a9-8a6036275e94 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.311823 Aug 23 22:30:16.204799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 409/737] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:15 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:16.212471 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-0069c2f0-2385-4a84-b9a9-52782982acbc req-1489bcbf-8f48-4ef5-ae85-a0bd63708593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d84b4a2f-7ca4-4281-84ff-69efdc3897a2", "tag": "2145ae08-8d67-45d5-bc60-d74ff38d6e5a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:16.233900 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0069c2f0-2385-4a84-b9a9-52782982acbc req-1489bcbf-8f48-4ef5-ae85-a0bd63708593 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:16.236249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0069c2f0-2385-4a84-b9a9-52782982acbc req-1489bcbf-8f48-4ef5-ae85-a0bd63708593 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:16.239527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0069c2f0-2385-4a84-b9a9-52782982acbc req-1489bcbf-8f48-4ef5-ae85-a0bd63708593 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:16.258005 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-0069c2f0-2385-4a84-b9a9-52782982acbc req-1489bcbf-8f48-4ef5-ae85-a0bd63708593 service nova] Creating event network-changed:2145ae08-8d67-45d5-bc60-d74ff38d6e5a for instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 on hv-cinder-85032 Aug 23 22:30:16.264756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-0069c2f0-2385-4a84-b9a9-52782982acbc req-1489bcbf-8f48-4ef5-ae85-a0bd63708593 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057944 Aug 23 22:30:16.265726 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 410/738] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:16.528075 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:16.529844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:16.548005 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:16.550113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:16.574339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:16.578204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:16.579247 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:16.582466 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:16.946924 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:16.965623 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:16.968982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:16.971279 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1952e1cb-08f9-4d42-918e-d2c6eeb63454 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.452493 Aug 23 22:30:16.972657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 411/739] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:16 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:30:16.982254 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c30a9704-0cfa-41a3-980a-03810cf6af25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:16.983160 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c30a9704-0cfa-41a3-980a-03810cf6af25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:16.994238 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c30a9704-0cfa-41a3-980a-03810cf6af25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:16.995026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c30a9704-0cfa-41a3-980a-03810cf6af25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:16.996020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c30a9704-0cfa-41a3-980a-03810cf6af25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:16.997594 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c30a9704-0cfa-41a3-980a-03810cf6af25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:16.998753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c30a9704-0cfa-41a3-980a-03810cf6af25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:17.000019 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c30a9704-0cfa-41a3-980a-03810cf6af25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:17.031895 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:17.145801 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-c30a9704-0cfa-41a3-980a-03810cf6af25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lazy-loading 'services' on Instance uuid d1c1b881-065d-4348-9ce8-50b4cb96585c {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:30:17.348587 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c30a9704-0cfa-41a3-980a-03810cf6af25 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments/661ce716-f517-4841-835e-045b1fe6367c" status: 202 len: 0 microversion: 2.1 time: 0.373391 Aug 23 22:30:17.350549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 412/740] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:30:16 2022] DELETE /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments/661ce716-f517-4841-835e-045b1fe6367c => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:30:17.364991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f662ac51-9eda-4802-a459-eb7cef4821d2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:17.366631 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f662ac51-9eda-4802-a459-eb7cef4821d2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:17.379553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f662ac51-9eda-4802-a459-eb7cef4821d2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:17.380481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f662ac51-9eda-4802-a459-eb7cef4821d2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:17.381288 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f662ac51-9eda-4802-a459-eb7cef4821d2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:17.382608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f662ac51-9eda-4802-a459-eb7cef4821d2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:17.383735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f662ac51-9eda-4802-a459-eb7cef4821d2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:17.384525 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f662ac51-9eda-4802-a459-eb7cef4821d2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:17.700478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f662ac51-9eda-4802-a459-eb7cef4821d2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:17.718357 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f662ac51-9eda-4802-a459-eb7cef4821d2 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.366023 Aug 23 22:30:17.720321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 413/741] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:17 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:17.732155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a0ce0aa1-dd6d-4fea-8801-93adf86eae19 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:17.736951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a0ce0aa1-dd6d-4fea-8801-93adf86eae19 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:17.752817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0ce0aa1-dd6d-4fea-8801-93adf86eae19 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:17.754272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0ce0aa1-dd6d-4fea-8801-93adf86eae19 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:17.755267 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0ce0aa1-dd6d-4fea-8801-93adf86eae19 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:17.756856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0ce0aa1-dd6d-4fea-8801-93adf86eae19 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:17.757689 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0ce0aa1-dd6d-4fea-8801-93adf86eae19 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:17.758402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a0ce0aa1-dd6d-4fea-8801-93adf86eae19 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:17.838580 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a0ce0aa1-dd6d-4fea-8801-93adf86eae19 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114740 Aug 23 22:30:17.839752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 414/742] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:30:17 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:18.020303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:18.021377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:18.041550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=24 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:18.049678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:18.053572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:18.058278 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:18.060653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:18.063395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:18.067621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:18.576284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:18.591802 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:18.595501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:18.598652 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-91d06aa3-5cc6-4513-8eab-891ddab31dae tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.585612 Aug 23 22:30:18.614704 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 415/743] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:18 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:30:18.770074 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c741b430-7763-4da6-997a-038b565deb6e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:18.770893 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c741b430-7763-4da6-997a-038b565deb6e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:18.794395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c741b430-7763-4da6-997a-038b565deb6e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:18.795191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c741b430-7763-4da6-997a-038b565deb6e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:18.796434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c741b430-7763-4da6-997a-038b565deb6e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:18.797424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c741b430-7763-4da6-997a-038b565deb6e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:18.798064 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c741b430-7763-4da6-997a-038b565deb6e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:18.798657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c741b430-7763-4da6-997a-038b565deb6e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:19.903376 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c741b430-7763-4da6-997a-038b565deb6e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:19.926817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c741b430-7763-4da6-997a-038b565deb6e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 1.170075 Aug 23 22:30:19.927416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 416/744] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:18 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:19.948832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-40a9c3ff-2b4b-4559-b8d9-6f154d629867 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:19.953538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-40a9c3ff-2b4b-4559-b8d9-6f154d629867 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:19.974075 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-40a9c3ff-2b4b-4559-b8d9-6f154d629867 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:19.976923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-40a9c3ff-2b4b-4559-b8d9-6f154d629867 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:19.978238 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-40a9c3ff-2b4b-4559-b8d9-6f154d629867 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:19.980126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-40a9c3ff-2b4b-4559-b8d9-6f154d629867 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:19.982577 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-40a9c3ff-2b4b-4559-b8d9-6f154d629867 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:19.983663 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-40a9c3ff-2b4b-4559-b8d9-6f154d629867 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:20.070190 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-40a9c3ff-2b4b-4559-b8d9-6f154d629867 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132703 Aug 23 22:30:20.071517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 417/745] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:30:19 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:20.080644 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:20.082654 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:20.094103 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:20.094934 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:20.095890 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:20.097880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:20.098904 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:20.099872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:20.382350 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:20.398444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:20.401408 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:20.403368 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-057aea8c-477a-463d-818b-b5375f6b16a0 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.329830 Aug 23 22:30:20.404263 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 418/746] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:20 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:20.951346 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-89aecfec-548d-47b8-9d04-389e536db55a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:20.953250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-89aecfec-548d-47b8-9d04-389e536db55a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:20.965547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89aecfec-548d-47b8-9d04-389e536db55a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:20.966504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89aecfec-548d-47b8-9d04-389e536db55a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:20.967227 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89aecfec-548d-47b8-9d04-389e536db55a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:20.968730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89aecfec-548d-47b8-9d04-389e536db55a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:20.969504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89aecfec-548d-47b8-9d04-389e536db55a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:20.970604 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89aecfec-548d-47b8-9d04-389e536db55a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:21.222476 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-89aecfec-548d-47b8-9d04-389e536db55a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:21.233154 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-89aecfec-548d-47b8-9d04-389e536db55a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.287205 Aug 23 22:30:21.233772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 419/747] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:20 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:21.241131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8d557af1-9ab1-40c4-b1eb-6d27b796cc9d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:21.244178 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8d557af1-9ab1-40c4-b1eb-6d27b796cc9d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:21.252331 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d557af1-9ab1-40c4-b1eb-6d27b796cc9d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:21.254447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d557af1-9ab1-40c4-b1eb-6d27b796cc9d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:21.255014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d557af1-9ab1-40c4-b1eb-6d27b796cc9d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:21.255800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d557af1-9ab1-40c4-b1eb-6d27b796cc9d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:21.256283 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d557af1-9ab1-40c4-b1eb-6d27b796cc9d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:21.256764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d557af1-9ab1-40c4-b1eb-6d27b796cc9d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:21.298080 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8d557af1-9ab1-40c4-b1eb-6d27b796cc9d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062637 Aug 23 22:30:21.298572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 420/748] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:30:21 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:21.443327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:21.444236 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:21.453172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:21.453887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:21.454550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:21.455385 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:21.456966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:21.457564 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:21.825579 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:21.832532 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:21.837869 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:21.839589 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:21.841180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-15c86481-07b6-4cbf-b748-5626691e38ec tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.404625 Aug 23 22:30:21.845118 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 421/749] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:21 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:30:22.265204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f351d303-e0bd-4c49-b7c6-2ceedd71170d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:22.266309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f351d303-e0bd-4c49-b7c6-2ceedd71170d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:22.276692 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f351d303-e0bd-4c49-b7c6-2ceedd71170d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:22.277209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f351d303-e0bd-4c49-b7c6-2ceedd71170d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:22.277637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f351d303-e0bd-4c49-b7c6-2ceedd71170d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:22.278371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f351d303-e0bd-4c49-b7c6-2ceedd71170d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:22.278819 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f351d303-e0bd-4c49-b7c6-2ceedd71170d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:22.279232 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f351d303-e0bd-4c49-b7c6-2ceedd71170d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:22.477221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f351d303-e0bd-4c49-b7c6-2ceedd71170d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:22.487002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f351d303-e0bd-4c49-b7c6-2ceedd71170d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.229095 Aug 23 22:30:22.501533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 422/750] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:22 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:22.511071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b654806a-94d8-4cab-aff0-93df2d7c9bbc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:22.514183 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b654806a-94d8-4cab-aff0-93df2d7c9bbc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:22.525960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b654806a-94d8-4cab-aff0-93df2d7c9bbc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:22.526749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b654806a-94d8-4cab-aff0-93df2d7c9bbc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:22.527789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b654806a-94d8-4cab-aff0-93df2d7c9bbc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:22.532589 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b654806a-94d8-4cab-aff0-93df2d7c9bbc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:22.534160 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b654806a-94d8-4cab-aff0-93df2d7c9bbc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:22.535726 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b654806a-94d8-4cab-aff0-93df2d7c9bbc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:22.602526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b654806a-94d8-4cab-aff0-93df2d7c9bbc tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099137 Aug 23 22:30:22.603617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 423/751] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:30:22 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:22.878939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:22.880193 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:22.893203 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:22.893584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:22.894655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:22.895995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:22.896842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:22.897487 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:23.333947 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:23.351734 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:23.355190 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:23.357563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ee97d787-7ef4-47cb-841e-5a6768a421ca tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.486323 Aug 23 22:30:23.358945 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 424/752] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:22 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:23.450646 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-35bc95b5-1afb-4f57-882e-89d8ce5f90ce req-0d59c0df-cb9f-4e73-9aa6-f7e9e0567227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb06a53f-d4f0-465e-9c75-8d72e44c0640", "name": "network-vif-plugged", "status": "completed", "tag": "edad9bc4-ba17-4879-b9ef-138943b74c95"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:23.468454 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-35bc95b5-1afb-4f57-882e-89d8ce5f90ce req-0d59c0df-cb9f-4e73-9aa6-f7e9e0567227 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:23.469212 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-35bc95b5-1afb-4f57-882e-89d8ce5f90ce req-0d59c0df-cb9f-4e73-9aa6-f7e9e0567227 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:23.469875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-35bc95b5-1afb-4f57-882e-89d8ce5f90ce req-0d59c0df-cb9f-4e73-9aa6-f7e9e0567227 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:23.492916 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-35bc95b5-1afb-4f57-882e-89d8ce5f90ce req-0d59c0df-cb9f-4e73-9aa6-f7e9e0567227 service nova] Creating event network-vif-plugged:edad9bc4-ba17-4879-b9ef-138943b74c95 for instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 on hv-cinder-85032 Aug 23 22:30:23.500294 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-35bc95b5-1afb-4f57-882e-89d8ce5f90ce req-0d59c0df-cb9f-4e73-9aa6-f7e9e0567227 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057175 Aug 23 22:30:23.501758 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 425/753] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:30:23.527889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a9c2b2ba-0a70-483c-819e-dc04c44cf5b9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:23.529595 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a9c2b2ba-0a70-483c-819e-dc04c44cf5b9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:23.542828 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9c2b2ba-0a70-483c-819e-dc04c44cf5b9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:23.543926 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9c2b2ba-0a70-483c-819e-dc04c44cf5b9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:23.544791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9c2b2ba-0a70-483c-819e-dc04c44cf5b9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:23.546525 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9c2b2ba-0a70-483c-819e-dc04c44cf5b9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:23.547640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9c2b2ba-0a70-483c-819e-dc04c44cf5b9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:23.548349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9c2b2ba-0a70-483c-819e-dc04c44cf5b9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:23.800816 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a9c2b2ba-0a70-483c-819e-dc04c44cf5b9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:23.834326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a9c2b2ba-0a70-483c-819e-dc04c44cf5b9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.317484 Aug 23 22:30:23.835415 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 426/754] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:23 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:23.840841 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-02d2990d-3dfe-44de-9688-0a603622c85f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:23.843528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-02d2990d-3dfe-44de-9688-0a603622c85f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:23.864791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-02d2990d-3dfe-44de-9688-0a603622c85f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:23.865496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-02d2990d-3dfe-44de-9688-0a603622c85f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:23.866026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-02d2990d-3dfe-44de-9688-0a603622c85f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:23.867040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-02d2990d-3dfe-44de-9688-0a603622c85f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:23.867871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-02d2990d-3dfe-44de-9688-0a603622c85f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:23.870261 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-02d2990d-3dfe-44de-9688-0a603622c85f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:23.930722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-02d2990d-3dfe-44de-9688-0a603622c85f tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093896 Aug 23 22:30:23.931879 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 427/755] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:30:23 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:30:24.095521 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b25c44e0-66e0-4d0b-9a8a-c32fc31ae10c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:24.098293 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b25c44e0-66e0-4d0b-9a8a-c32fc31ae10c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:24.126507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b25c44e0-66e0-4d0b-9a8a-c32fc31ae10c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:24.127508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b25c44e0-66e0-4d0b-9a8a-c32fc31ae10c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:24.128029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b25c44e0-66e0-4d0b-9a8a-c32fc31ae10c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:24.129129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b25c44e0-66e0-4d0b-9a8a-c32fc31ae10c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:24.130206 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b25c44e0-66e0-4d0b-9a8a-c32fc31ae10c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:24.131111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b25c44e0-66e0-4d0b-9a8a-c32fc31ae10c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:24.195139 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b25c44e0-66e0-4d0b-9a8a-c32fc31ae10c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:30:24.405884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b25c44e0-66e0-4d0b-9a8a-c32fc31ae10c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 204 len: 0 microversion: 2.1 time: 0.318171 Aug 23 22:30:24.418349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 428/756] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:30:24 2022] DELETE /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:30:24.434341 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:24.436283 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:24.464857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:24.464857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:24.464857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:24.467944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:24.467944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:24.469303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:24.741139 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:24.753698 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:24.756205 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:24.757508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7a34e7ac-9c6c-4a49-9abb-27769c6d5405 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.337163 Aug 23 22:30:24.758528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 429/757] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:24 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:24.774746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d67fea67-3942-4169-8682-769759d3a91b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:24.775609 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d67fea67-3942-4169-8682-769759d3a91b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:24.797602 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d67fea67-3942-4169-8682-769759d3a91b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:24.798111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d67fea67-3942-4169-8682-769759d3a91b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:24.799004 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d67fea67-3942-4169-8682-769759d3a91b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:24.800624 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d67fea67-3942-4169-8682-769759d3a91b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:24.801243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d67fea67-3942-4169-8682-769759d3a91b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:24.802232 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d67fea67-3942-4169-8682-769759d3a91b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:25.100351 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d67fea67-3942-4169-8682-769759d3a91b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:25.111708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d67fea67-3942-4169-8682-769759d3a91b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1692 microversion: 2.1 time: 0.351804 Aug 23 22:30:25.113101 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 430/758] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:24 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1692 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:25.135032 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-baba968a-afd4-47d1-973e-e08058447c7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:25.139056 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-baba968a-afd4-47d1-973e-e08058447c7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:25.148617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baba968a-afd4-47d1-973e-e08058447c7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:25.149428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baba968a-afd4-47d1-973e-e08058447c7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:25.150209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baba968a-afd4-47d1-973e-e08058447c7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:25.151553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baba968a-afd4-47d1-973e-e08058447c7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:25.152384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baba968a-afd4-47d1-973e-e08058447c7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:25.153845 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-baba968a-afd4-47d1-973e-e08058447c7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:25.417351 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-baba968a-afd4-47d1-973e-e08058447c7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:25.434619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-baba968a-afd4-47d1-973e-e08058447c7d tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.299716 Aug 23 22:30:25.434619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 431/759] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:25 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:25.807502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:25.809362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:25.819077 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:25.819736 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:25.820394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:25.821563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:25.821908 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:25.822443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:26.023717 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:26.041259 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:26.045110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:26.047468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b21b3ab2-a7b9-47ff-a73c-abdbe4b0314e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.250225 Aug 23 22:30:26.048737 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 432/760] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:25 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:26.140627 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-302e380d-2141-4093-bbe7-b74e462bb057 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:26.141732 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-302e380d-2141-4093-bbe7-b74e462bb057 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:26.155834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-302e380d-2141-4093-bbe7-b74e462bb057 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:26.156964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-302e380d-2141-4093-bbe7-b74e462bb057 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:26.157991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-302e380d-2141-4093-bbe7-b74e462bb057 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:26.160831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-302e380d-2141-4093-bbe7-b74e462bb057 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:26.162353 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-302e380d-2141-4093-bbe7-b74e462bb057 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:26.165651 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-302e380d-2141-4093-bbe7-b74e462bb057 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:26.510143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-302e380d-2141-4093-bbe7-b74e462bb057 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:26.531301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-302e380d-2141-4093-bbe7-b74e462bb057 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1692 microversion: 2.1 time: 0.398625 Aug 23 22:30:26.531894 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 433/761] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:26 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1692 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:26.537436 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-656b686d-9a75-46cd-93a4-42b7cb2bf61f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:26.538051 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-656b686d-9a75-46cd-93a4-42b7cb2bf61f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:26.548402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-656b686d-9a75-46cd-93a4-42b7cb2bf61f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:26.549026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-656b686d-9a75-46cd-93a4-42b7cb2bf61f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:26.550462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-656b686d-9a75-46cd-93a4-42b7cb2bf61f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:26.551481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-656b686d-9a75-46cd-93a4-42b7cb2bf61f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:26.553123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-656b686d-9a75-46cd-93a4-42b7cb2bf61f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:26.553337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-656b686d-9a75-46cd-93a4-42b7cb2bf61f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:26.773586 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-656b686d-9a75-46cd-93a4-42b7cb2bf61f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:26.790430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-656b686d-9a75-46cd-93a4-42b7cb2bf61f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.257025 Aug 23 22:30:26.795702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 434/762] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:26 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:27.085094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:27.085524 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:27.095715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:27.096218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:27.097326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:27.098472 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:27.098780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:27.099210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:27.383134 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:27.408662 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:27.414020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:27.422442 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9e2c8d12-db98-4f3f-a21b-9ea7836f3e9a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.341873 Aug 23 22:30:27.423566 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 435/763] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:27 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:27.586132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-93a452ab-3eb9-4562-a308-b90648b4ca1b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:27.587355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-93a452ab-3eb9-4562-a308-b90648b4ca1b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:27.609718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93a452ab-3eb9-4562-a308-b90648b4ca1b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:27.610513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93a452ab-3eb9-4562-a308-b90648b4ca1b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:27.611316 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93a452ab-3eb9-4562-a308-b90648b4ca1b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:27.613857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93a452ab-3eb9-4562-a308-b90648b4ca1b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:27.614729 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93a452ab-3eb9-4562-a308-b90648b4ca1b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:27.615518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93a452ab-3eb9-4562-a308-b90648b4ca1b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:27.895717 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-93a452ab-3eb9-4562-a308-b90648b4ca1b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:27.907950 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-93a452ab-3eb9-4562-a308-b90648b4ca1b tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1692 microversion: 2.1 time: 0.332136 Aug 23 22:30:27.910507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 436/764] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:27 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1692 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:30:27.938607 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-453aa351-1804-42ee-853a-8c4b66725a18 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:27.946760 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-453aa351-1804-42ee-853a-8c4b66725a18 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:27.965499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-453aa351-1804-42ee-853a-8c4b66725a18 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:27.966416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-453aa351-1804-42ee-853a-8c4b66725a18 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:27.967222 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-453aa351-1804-42ee-853a-8c4b66725a18 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:27.968648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-453aa351-1804-42ee-853a-8c4b66725a18 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:27.977396 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-453aa351-1804-42ee-853a-8c4b66725a18 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:27.979305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-453aa351-1804-42ee-853a-8c4b66725a18 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:28.023834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:28.358559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-453aa351-1804-42ee-853a-8c4b66725a18 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:28.369869 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-453aa351-1804-42ee-853a-8c4b66725a18 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.451965 Aug 23 22:30:28.378432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 437/765] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:27 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:28.460849 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:28.461900 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:28.475078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:28.476350 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:28.476884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:28.478164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:28.478775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:28.479234 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:29.144615 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:29.171929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:29.177439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:29.180727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3738a076-378c-4dc3-976a-d89171968c5e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.724317 Aug 23 22:30:29.182500 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 438/766] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:28 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:30:29.205402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c18fb2bc-99d3-4d9c-946d-8d024ca22b7d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:29.207817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c18fb2bc-99d3-4d9c-946d-8d024ca22b7d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:29.219561 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c18fb2bc-99d3-4d9c-946d-8d024ca22b7d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:29.230298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c18fb2bc-99d3-4d9c-946d-8d024ca22b7d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:29.230298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c18fb2bc-99d3-4d9c-946d-8d024ca22b7d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:29.230298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c18fb2bc-99d3-4d9c-946d-8d024ca22b7d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:29.230298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c18fb2bc-99d3-4d9c-946d-8d024ca22b7d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:29.231094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c18fb2bc-99d3-4d9c-946d-8d024ca22b7d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:29.813110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c18fb2bc-99d3-4d9c-946d-8d024ca22b7d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:29.845994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c18fb2bc-99d3-4d9c-946d-8d024ca22b7d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1692 microversion: 2.1 time: 0.661471 Aug 23 22:30:29.853567 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 439/767] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:29 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1692 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:29.866650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1537f4a9-fe50-447e-8d60-7f1884efbd31 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:29.873649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1537f4a9-fe50-447e-8d60-7f1884efbd31 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:29.897871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1537f4a9-fe50-447e-8d60-7f1884efbd31 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:29.901972 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1537f4a9-fe50-447e-8d60-7f1884efbd31 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:29.904620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1537f4a9-fe50-447e-8d60-7f1884efbd31 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:29.906310 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1537f4a9-fe50-447e-8d60-7f1884efbd31 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:29.911204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1537f4a9-fe50-447e-8d60-7f1884efbd31 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:29.912409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1537f4a9-fe50-447e-8d60-7f1884efbd31 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:30.562995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1537f4a9-fe50-447e-8d60-7f1884efbd31 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:30.581673 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1537f4a9-fe50-447e-8d60-7f1884efbd31 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1360 microversion: 2.1 time: 0.725509 Aug 23 22:30:30.598025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 440/768] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:29 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1360 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:31.370527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-0897e6ce-4a56-4457-91e4-4ef633a39f35 req-19a1d500-614b-4b1f-8e9d-ac2676bfbab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84b4a2f-7ca4-4281-84ff-69efdc3897a2", "name": "network-vif-plugged", "status": "completed", "tag": "2145ae08-8d67-45d5-bc60-d74ff38d6e5a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:31.401261 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0897e6ce-4a56-4457-91e4-4ef633a39f35 req-19a1d500-614b-4b1f-8e9d-ac2676bfbab7 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:31.402206 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0897e6ce-4a56-4457-91e4-4ef633a39f35 req-19a1d500-614b-4b1f-8e9d-ac2676bfbab7 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:31.402998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0897e6ce-4a56-4457-91e4-4ef633a39f35 req-19a1d500-614b-4b1f-8e9d-ac2676bfbab7 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:31.420114 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-0897e6ce-4a56-4457-91e4-4ef633a39f35 req-19a1d500-614b-4b1f-8e9d-ac2676bfbab7 service nova] Creating event network-vif-plugged:2145ae08-8d67-45d5-bc60-d74ff38d6e5a for instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 on hv-cinder-85032 Aug 23 22:30:31.429812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-0897e6ce-4a56-4457-91e4-4ef633a39f35 req-19a1d500-614b-4b1f-8e9d-ac2676bfbab7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.828963 Aug 23 22:30:31.430906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 441/769] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:31.439314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:31.441362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:31.450496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:31.451317 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:31.451959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:31.452884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:31.453556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:31.454177 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:32.066816 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:32.080639 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:32.088477 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:32.093324 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b874f62a-ac80-4ba7-abc5-171ae5ba40fd tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.660419 Aug 23 22:30:32.097115 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 442/770] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:31 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:32.127289 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:32.130273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:32.156997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:32.160524 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:32.162610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:32.164217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:32.169927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:32.172008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:32.274473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:32.279572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:32.281244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:32.284592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lazy-loading 'fault' on Instance uuid d1c1b881-065d-4348-9ce8-50b4cb96585c {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:30:32.506381 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:32.529857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7cfc59ff-e9db-4a19-803d-00039b523fec tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 200 len: 1336 microversion: 2.1 time: 0.430747 Aug 23 22:30:32.530772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 443/771] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:32 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 1336 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:33.088142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-4c53d8e6-5d73-4b11-95bb-129828c8d266 req-c4438f79-6433-468e-b100-895d82303118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c1b881-065d-4348-9ce8-50b4cb96585c", "name": "network-vif-deleted", "tag": "e22c6f1c-3320-443a-8bec-aafb2744b504"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:33.107649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-4c53d8e6-5d73-4b11-95bb-129828c8d266 req-c4438f79-6433-468e-b100-895d82303118 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:33.108888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-4c53d8e6-5d73-4b11-95bb-129828c8d266 req-c4438f79-6433-468e-b100-895d82303118 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:33.110019 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-4c53d8e6-5d73-4b11-95bb-129828c8d266 req-c4438f79-6433-468e-b100-895d82303118 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:33.393410 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-4c53d8e6-5d73-4b11-95bb-129828c8d266 req-c4438f79-6433-468e-b100-895d82303118 service nova] Creating event network-vif-deleted:e22c6f1c-3320-443a-8bec-aafb2744b504 for instance d1c1b881-065d-4348-9ce8-50b4cb96585c on hv-cinder-85032 Aug 23 22:30:33.402658 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-4c53d8e6-5d73-4b11-95bb-129828c8d266 req-c4438f79-6433-468e-b100-895d82303118 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.870007 Aug 23 22:30:33.403694 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 444/772] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:33.412525 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f382d036-565d-4778-94f2-62b79121fb78 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:33.413623 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f382d036-565d-4778-94f2-62b79121fb78 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:33.425026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f382d036-565d-4778-94f2-62b79121fb78 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:33.426527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f382d036-565d-4778-94f2-62b79121fb78 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:33.427859 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f382d036-565d-4778-94f2-62b79121fb78 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:33.429555 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f382d036-565d-4778-94f2-62b79121fb78 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:33.430712 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f382d036-565d-4778-94f2-62b79121fb78 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:33.431770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f382d036-565d-4778-94f2-62b79121fb78 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:33.711957 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f382d036-565d-4778-94f2-62b79121fb78 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:33.733941 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f382d036-565d-4778-94f2-62b79121fb78 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1546 microversion: 2.1 time: 0.328106 Aug 23 22:30:33.735998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 445/773] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:33 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1546 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:33.746659 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-db00f17d-93f8-445b-9fae-d529b4f159f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:33.747744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-db00f17d-93f8-445b-9fae-d529b4f159f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:33.764490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db00f17d-93f8-445b-9fae-d529b4f159f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:33.765740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db00f17d-93f8-445b-9fae-d529b4f159f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:33.767033 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db00f17d-93f8-445b-9fae-d529b4f159f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:33.770080 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db00f17d-93f8-445b-9fae-d529b4f159f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:33.774091 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db00f17d-93f8-445b-9fae-d529b4f159f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:33.775778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db00f17d-93f8-445b-9fae-d529b4f159f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:33.999330 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-db00f17d-93f8-445b-9fae-d529b4f159f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lazy-loading 'services' on Instance uuid 1e60237b-94d3-441b-b7d5-ca559d89b007 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:30:34.250865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-db00f17d-93f8-445b-9fae-d529b4f159f3 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007/os-volume_attachments/294a79ca-4acd-490d-97ce-97c4f82c9c54" status: 202 len: 0 microversion: 2.1 time: 0.511509 Aug 23 22:30:34.254709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 446/774] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:30:33 2022] DELETE /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007/os-volume_attachments/294a79ca-4acd-490d-97ce-97c4f82c9c54 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:30:34.280883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:34.291802 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:34.320008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:34.320808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:34.322183 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:34.324191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:34.325142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:34.325772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:34.798015 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:34.825429 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:34.840550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:34.843010 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c208d596-1d8d-406d-9285-6fd9991867c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1407 microversion: 2.20 time: 0.584161 Aug 23 22:30:34.844476 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 447/775] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:34 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:30:34.864696 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:34.865687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: d1c1b881-065d-4348-9ce8-50b4cb96585c] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:34.883826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:34.894006 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:34.898358 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:34.899979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:34.915151 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:34.915590 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:34.963558 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] HTTP exception thrown: Instance d1c1b881-065d-4348-9ce8-50b4cb96585c could not be found. Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Request method failure captured: Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c HTTP/1.1 Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOv13_MU_50s_aHvDIST8LDnTZeNLrXoKO_9tRpymYOQxPByczIdikrorzz5bnQJNXBXY2DsLSgLVa6dVPKD_ZD2k345A6vw_H8htZmqauzwSRk2seRexlxlvlsqvtICY93c2IqIF6AlW97HMPeU9BZNrOrD_PqMIc0CmBjXZp0CDg Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 1dfc84dc05d542d987194096f3b7e51a Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:30:34.973438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1dfc84dc05d542d987194096f3b7e51a"}]}] Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 1dfc84dc05d542d987194096f3b7e51a Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-ServerRescueNegativeTestJSON-146746916-project Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 78b05a538ce0466ea8b3e27a0a6fc162 Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-ServerRescueNegativeTestJSON-146746916-project Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance d1c1b881-065d-4348-9ce8-50b4cb96585c could not be found. Aug 23 22:30:34.974865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'd1c1b881-065d-4348-9ce8-50b4cb96585c'} Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c1b881-065d-4348-9ce8-50b4cb96585c could not be found. Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:30:34.975701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c1b881-065d-4348-9ce8-50b4cb96585c could not be found. Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c1b881-065d-4348-9ce8-50b4cb96585c could not be found. Aug 23 22:30:34.977141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:34.981170 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Returning 404 to user: Instance d1c1b881-065d-4348-9ce8-50b4cb96585c could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:30:34.982328 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3b33da53-662e-491f-af6b-07f046d43c84 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c" status: 404 len: 111 microversion: 2.1 time: 0.136621 Aug 23 22:30:34.987321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 448/776] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:34 2022] GET /compute/v2.1/servers/d1c1b881-065d-4348-9ce8-50b4cb96585c => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:30:34.997858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3bf5b0b9-4a13-4d64-8e28-8265a8cf1c02 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:34.998651 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3bf5b0b9-4a13-4d64-8e28-8265a8cf1c02 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:35.009317 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bf5b0b9-4a13-4d64-8e28-8265a8cf1c02 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:35.010340 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bf5b0b9-4a13-4d64-8e28-8265a8cf1c02 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:35.011233 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bf5b0b9-4a13-4d64-8e28-8265a8cf1c02 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:35.015239 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bf5b0b9-4a13-4d64-8e28-8265a8cf1c02 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:35.016697 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bf5b0b9-4a13-4d64-8e28-8265a8cf1c02 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:35.017863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bf5b0b9-4a13-4d64-8e28-8265a8cf1c02 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:35.198441 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3bf5b0b9-4a13-4d64-8e28-8265a8cf1c02 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.203955 Aug 23 22:30:35.203081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 449/777] 10.222.0.88 () {58 vars in 1275 bytes} [Tue Aug 23 22:30:34 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:35.216942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f5e3d972-5dff-4a5e-be8c-4d21ef20fe20 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '.version_select at 0x7f901fe005e0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:35.361164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f5e3d972-5dff-4a5e-be8c-4d21ef20fe20 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1919205478" status: 202 len: 0 microversion: 2.1 time: 0.155644 Aug 23 22:30:35.363665 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 450/778] 10.222.0.88 () {58 vars in 1221 bytes} [Tue Aug 23 22:30:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1919205478 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:30:35.890594 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:35.892523 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:35.900882 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:35.927059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:35.929623 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:35.930977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:35.932816 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:35.933699 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:35.934363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:37.009519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:37.052319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:37.056634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:37.064600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-94cbee39-2abe-4ffa-bc71-6b6e8a4ba673 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1598 microversion: 2.20 time: 1.184044 Aug 23 22:30:37.083062 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 451/779] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:30:35 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1598 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:30:37.132298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-aa864aed-935c-4976-9c44-b21b34ccb4a4 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:37.134912 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-aa864aed-935c-4976-9c44-b21b34ccb4a4 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:37.161379 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa864aed-935c-4976-9c44-b21b34ccb4a4 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:37.166275 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa864aed-935c-4976-9c44-b21b34ccb4a4 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:37.173369 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa864aed-935c-4976-9c44-b21b34ccb4a4 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:37.175158 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa864aed-935c-4976-9c44-b21b34ccb4a4 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:37.175968 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa864aed-935c-4976-9c44-b21b34ccb4a4 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:37.176520 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-aa864aed-935c-4976-9c44-b21b34ccb4a4 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:37.301038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-aa864aed-935c-4976-9c44-b21b34ccb4a4 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:30:37.557243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-aa864aed-935c-4976-9c44-b21b34ccb4a4 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 204 len: 0 microversion: 2.1 time: 0.440599 Aug 23 22:30:37.557753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 452/780] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:30:37 2022] DELETE /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:30:37.564523 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-08f4dfd7-b5a8-455a-b680-e6e210cdbf62 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:37.566641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-08f4dfd7-b5a8-455a-b680-e6e210cdbf62 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:37.576966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08f4dfd7-b5a8-455a-b680-e6e210cdbf62 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:37.578752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08f4dfd7-b5a8-455a-b680-e6e210cdbf62 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:37.579765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08f4dfd7-b5a8-455a-b680-e6e210cdbf62 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:37.581608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08f4dfd7-b5a8-455a-b680-e6e210cdbf62 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:37.583559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08f4dfd7-b5a8-455a-b680-e6e210cdbf62 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:37.584434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-08f4dfd7-b5a8-455a-b680-e6e210cdbf62 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:38.266132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-08f4dfd7-b5a8-455a-b680-e6e210cdbf62 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.706773 Aug 23 22:30:38.267057 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 453/781] 10.222.0.88 () {60 vars in 1316 bytes} [Tue Aug 23 22:30:37 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/os-interface => generated 284 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:30:38.273347 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4285f4e8-5fb1-4c0d-a774-61ed8a635434 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:38.278366 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4285f4e8-5fb1-4c0d-a774-61ed8a635434 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:38.302103 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4285f4e8-5fb1-4c0d-a774-61ed8a635434 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:38.305608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4285f4e8-5fb1-4c0d-a774-61ed8a635434 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:38.306431 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4285f4e8-5fb1-4c0d-a774-61ed8a635434 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:38.307375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4285f4e8-5fb1-4c0d-a774-61ed8a635434 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:38.313725 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4285f4e8-5fb1-4c0d-a774-61ed8a635434 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:38.314830 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4285f4e8-5fb1-4c0d-a774-61ed8a635434 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:39.252407 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4285f4e8-5fb1-4c0d-a774-61ed8a635434 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:39.295817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4285f4e8-5fb1-4c0d-a774-61ed8a635434 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1512 microversion: 2.1 time: 1.027069 Aug 23 22:30:39.307109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 454/782] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:38 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1512 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:39.323073 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-22f551f6-5cc8-4db7-9d20-597f0e32d67a req-e4636686-67d2-4b08-b03d-5c9e6bf67e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb06a53f-d4f0-465e-9c75-8d72e44c0640", "tag": "edad9bc4-ba17-4879-b9ef-138943b74c95"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:39.406322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-22f551f6-5cc8-4db7-9d20-597f0e32d67a req-e4636686-67d2-4b08-b03d-5c9e6bf67e86 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:39.407213 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-22f551f6-5cc8-4db7-9d20-597f0e32d67a req-e4636686-67d2-4b08-b03d-5c9e6bf67e86 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:39.412098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-22f551f6-5cc8-4db7-9d20-597f0e32d67a req-e4636686-67d2-4b08-b03d-5c9e6bf67e86 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:39.476175 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:39.489094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-22f551f6-5cc8-4db7-9d20-597f0e32d67a req-e4636686-67d2-4b08-b03d-5c9e6bf67e86 service nova] Creating event network-changed:edad9bc4-ba17-4879-b9ef-138943b74c95 for instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 on hv-cinder-85032 Aug 23 22:30:39.519823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-22f551f6-5cc8-4db7-9d20-597f0e32d67a req-e4636686-67d2-4b08-b03d-5c9e6bf67e86 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207342 Aug 23 22:30:39.525663 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 455/783] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:40.340970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-931d2339-5775-48e4-9af9-15428f2c1485 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:40.341993 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-931d2339-5775-48e4-9af9-15428f2c1485 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:40.387694 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-931d2339-5775-48e4-9af9-15428f2c1485 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:40.392220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-931d2339-5775-48e4-9af9-15428f2c1485 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:40.393327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-931d2339-5775-48e4-9af9-15428f2c1485 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:40.393974 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-931d2339-5775-48e4-9af9-15428f2c1485 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:40.394619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-931d2339-5775-48e4-9af9-15428f2c1485 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:40.395362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-931d2339-5775-48e4-9af9-15428f2c1485 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:41.539237 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-931d2339-5775-48e4-9af9-15428f2c1485 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:41.560409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-931d2339-5775-48e4-9af9-15428f2c1485 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1512 microversion: 2.1 time: 1.227712 Aug 23 22:30:41.562187 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 456/784] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:40 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1512 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:41.896053 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-271b6ab0-1097-47e4-ab50-08255fc040e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:41.898964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-271b6ab0-1097-47e4-ab50-08255fc040e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:41.919592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-271b6ab0-1097-47e4-ab50-08255fc040e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:41.923262 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-271b6ab0-1097-47e4-ab50-08255fc040e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:41.924768 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-271b6ab0-1097-47e4-ab50-08255fc040e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:41.926480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-271b6ab0-1097-47e4-ab50-08255fc040e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:41.927849 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-271b6ab0-1097-47e4-ab50-08255fc040e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:41.928940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-271b6ab0-1097-47e4-ab50-08255fc040e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:42.397800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-271b6ab0-1097-47e4-ab50-08255fc040e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:42.412822 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-271b6ab0-1097-47e4-ab50-08255fc040e7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1557 microversion: 2.1 time: 0.529998 Aug 23 22:30:42.414812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 457/785] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:41 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1557 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:42.443251 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-215fb8bb-b2b6-4097-9098-ffbcbb537a7e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:42.444038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-215fb8bb-b2b6-4097-9098-ffbcbb537a7e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:42.453438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-215fb8bb-b2b6-4097-9098-ffbcbb537a7e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:42.463420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-215fb8bb-b2b6-4097-9098-ffbcbb537a7e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:42.464461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-215fb8bb-b2b6-4097-9098-ffbcbb537a7e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:42.465115 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-215fb8bb-b2b6-4097-9098-ffbcbb537a7e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:42.468145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-215fb8bb-b2b6-4097-9098-ffbcbb537a7e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:42.468145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-215fb8bb-b2b6-4097-9098-ffbcbb537a7e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:42.760427 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-215fb8bb-b2b6-4097-9098-ffbcbb537a7e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.321720 Aug 23 22:30:42.777550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 458/786] 10.222.0.88 () {58 vars in 1275 bytes} [Tue Aug 23 22:30:42 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-interface => generated 284 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:42.810499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:42.813747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:42.837985 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:42.838489 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:42.838940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:42.839835 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:42.840695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:42.841465 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:42.943426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:42.946130 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:42.947446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:42.948847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lazy-loading 'fault' on Instance uuid 1e60237b-94d3-441b-b7d5-ca559d89b007 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:30:43.028093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5918150a21314cf2b28bcee3072457ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73aca04a5685447fb698a46da1b0b8ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:43.043493 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1bc3d8fd-0e33-4229-afd9-66566f0db512 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 200 len: 1309 microversion: 2.1 time: 0.268249 Aug 23 22:30:43.044541 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 459/787] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:42 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 1309 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:43.298959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-3872e230-94c1-425a-8aa9-a771665fbe41 req-642dd95b-bc6b-4601-a604-f2b317c583bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e60237b-94d3-441b-b7d5-ca559d89b007", "name": "network-vif-deleted", "tag": "f3cc9f8e-d4bb-4be5-9331-919d7c7999fc"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:43.320209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3872e230-94c1-425a-8aa9-a771665fbe41 req-642dd95b-bc6b-4601-a604-f2b317c583bb service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:43.321174 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3872e230-94c1-425a-8aa9-a771665fbe41 req-642dd95b-bc6b-4601-a604-f2b317c583bb service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:43.321918 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3872e230-94c1-425a-8aa9-a771665fbe41 req-642dd95b-bc6b-4601-a604-f2b317c583bb service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:43.345669 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-3872e230-94c1-425a-8aa9-a771665fbe41 req-642dd95b-bc6b-4601-a604-f2b317c583bb service nova] Creating event network-vif-deleted:f3cc9f8e-d4bb-4be5-9331-919d7c7999fc for instance 1e60237b-94d3-441b-b7d5-ca559d89b007 on hv-cinder-85032 Aug 23 22:30:43.358518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-3872e230-94c1-425a-8aa9-a771665fbe41 req-642dd95b-bc6b-4601-a604-f2b317c583bb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311517 Aug 23 22:30:43.359264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 460/788] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:43.652875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-f417d44d-4249-4f24-a722-8cb3dbd5c775 req-c3b08cc0-736a-4fc3-b549-79dedb41a5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d84b4a2f-7ca4-4281-84ff-69efdc3897a2", "tag": "2145ae08-8d67-45d5-bc60-d74ff38d6e5a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:43.684371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-f417d44d-4249-4f24-a722-8cb3dbd5c775 req-c3b08cc0-736a-4fc3-b549-79dedb41a5f4 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:43.686131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-f417d44d-4249-4f24-a722-8cb3dbd5c775 req-c3b08cc0-736a-4fc3-b549-79dedb41a5f4 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:43.686913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-f417d44d-4249-4f24-a722-8cb3dbd5c775 req-c3b08cc0-736a-4fc3-b549-79dedb41a5f4 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:43.727629 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-f417d44d-4249-4f24-a722-8cb3dbd5c775 req-c3b08cc0-736a-4fc3-b549-79dedb41a5f4 service nova] Creating event network-changed:2145ae08-8d67-45d5-bc60-d74ff38d6e5a for instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 on hv-cinder-85032 Aug 23 22:30:43.742871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-f417d44d-4249-4f24-a722-8cb3dbd5c775 req-c3b08cc0-736a-4fc3-b549-79dedb41a5f4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094312 Aug 23 22:30:43.748162 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 461/789] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:30:43.764787 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9e4b96fd-e846-48b9-a624-0f01a26aec31 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:43.766602 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9e4b96fd-e846-48b9-a624-0f01a26aec31 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:43.795981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e4b96fd-e846-48b9-a624-0f01a26aec31 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:43.802184 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e4b96fd-e846-48b9-a624-0f01a26aec31 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:43.804410 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e4b96fd-e846-48b9-a624-0f01a26aec31 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:43.806317 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e4b96fd-e846-48b9-a624-0f01a26aec31 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:43.807627 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e4b96fd-e846-48b9-a624-0f01a26aec31 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:43.809780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9e4b96fd-e846-48b9-a624-0f01a26aec31 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:43.917913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9e4b96fd-e846-48b9-a624-0f01a26aec31 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:30:44.211381 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9e4b96fd-e846-48b9-a624-0f01a26aec31 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "DELETE /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 204 len: 0 microversion: 2.1 time: 0.460017 Aug 23 22:30:44.216680 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 462/790] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:30:43 2022] DELETE /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:30:44.224165 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:44.224978 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] [instance: 1e60237b-94d3-441b-b7d5-ca559d89b007] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:44.258436 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:44.258949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:44.259435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:44.260145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:44.260603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:44.261146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:44.304503 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] HTTP exception thrown: Instance 1e60237b-94d3-441b-b7d5-ca559d89b007 could not be found. Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Request method failure captured: Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 HTTP/1.1 Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVSEbDGLGzb_l-zVYUSfYg6ilurJ9PrxRh6isuSrv-aK9_uQqfmZfni-RcnqquLTO9iMubRJceky-Vdjz-2ZHnJG4algOlPcoNfywFOD--0A8AQsYqOqPsIKeoaaweDsWubf_8heEo6qsl7WD0ND3_bITN0fK15T1TiCg-vTIDpBHas Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 73aca04a5685447fb698a46da1b0b8ff Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesSnapshotTestJSON-79294332 Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:30:44.312344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/73aca04a5685447fb698a46da1b0b8ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_73aca04a5685447fb698a46da1b0b8ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/73aca04a5685447fb698a46da1b0b8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/73aca04a5685447fb698a46da1b0b8ff"}]}] Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesSnapshotTestJSON-79294332 Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 73aca04a5685447fb698a46da1b0b8ff Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-79294332 Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesSnapshotTestJSON-79294332-project Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 5918150a21314cf2b28bcee3072457ae Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesSnapshotTestJSON-79294332-project Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 1e60237b-94d3-441b-b7d5-ca559d89b007 could not be found. Aug 23 22:30:44.314649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '1e60237b-94d3-441b-b7d5-ca559d89b007'} Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e60237b-94d3-441b-b7d5-ca559d89b007 could not be found. Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:30:44.316824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e60237b-94d3-441b-b7d5-ca559d89b007 could not be found. Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e60237b-94d3-441b-b7d5-ca559d89b007 could not be found. Aug 23 22:30:44.318991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:44.324652 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] Returning 404 to user: Instance 1e60237b-94d3-441b-b7d5-ca559d89b007 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:30:44.327153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-66af0add-b97a-4de1-953f-b8950bb48960 tempest-VolumesSnapshotTestJSON-79294332 tempest-VolumesSnapshotTestJSON-79294332-project] 10.222.0.88 "GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007" status: 404 len: 111 microversion: 2.1 time: 0.109432 Aug 23 22:30:44.342420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 463/791] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:44 2022] GET /compute/v2.1/servers/1e60237b-94d3-441b-b7d5-ca559d89b007 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:30:44.352907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-55bb6c02-f8af-4de2-b106-5baa7c0ae761 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:44.354070 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-55bb6c02-f8af-4de2-b106-5baa7c0ae761 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:44.379556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55bb6c02-f8af-4de2-b106-5baa7c0ae761 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:44.380439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55bb6c02-f8af-4de2-b106-5baa7c0ae761 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:44.381205 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55bb6c02-f8af-4de2-b106-5baa7c0ae761 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:44.382208 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55bb6c02-f8af-4de2-b106-5baa7c0ae761 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:44.383629 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55bb6c02-f8af-4de2-b106-5baa7c0ae761 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:44.388462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-55bb6c02-f8af-4de2-b106-5baa7c0ae761 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:44.845042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-55bb6c02-f8af-4de2-b106-5baa7c0ae761 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:44.868132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-55bb6c02-f8af-4de2-b106-5baa7c0ae761 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1507 microversion: 2.1 time: 0.523342 Aug 23 22:30:44.871118 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 464/792] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:44 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1507 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:45.921826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-89ac8860-bff3-4854-9bf7-5adf60ba257c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:45.926342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-89ac8860-bff3-4854-9bf7-5adf60ba257c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:45.955082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89ac8860-bff3-4854-9bf7-5adf60ba257c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:45.962933 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89ac8860-bff3-4854-9bf7-5adf60ba257c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:45.965522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89ac8860-bff3-4854-9bf7-5adf60ba257c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:45.968695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89ac8860-bff3-4854-9bf7-5adf60ba257c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:45.969653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89ac8860-bff3-4854-9bf7-5adf60ba257c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:45.970424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-89ac8860-bff3-4854-9bf7-5adf60ba257c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:46.720259 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-89ac8860-bff3-4854-9bf7-5adf60ba257c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:46.780424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-89ac8860-bff3-4854-9bf7-5adf60ba257c tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1507 microversion: 2.1 time: 0.870498 Aug 23 22:30:46.806388 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 465/793] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:45 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1507 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:47.835525 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e8c99be5-4c5c-4afe-9db4-78ed6eed072d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:47.837399 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e8c99be5-4c5c-4afe-9db4-78ed6eed072d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:47.853473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e8c99be5-4c5c-4afe-9db4-78ed6eed072d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:47.854750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e8c99be5-4c5c-4afe-9db4-78ed6eed072d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:47.858066 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e8c99be5-4c5c-4afe-9db4-78ed6eed072d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:47.859294 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e8c99be5-4c5c-4afe-9db4-78ed6eed072d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:47.859964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e8c99be5-4c5c-4afe-9db4-78ed6eed072d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:47.860680 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e8c99be5-4c5c-4afe-9db4-78ed6eed072d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:48.301914 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e8c99be5-4c5c-4afe-9db4-78ed6eed072d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:48.362522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e8c99be5-4c5c-4afe-9db4-78ed6eed072d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1507 microversion: 2.1 time: 0.532122 Aug 23 22:30:48.365272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 466/794] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:47 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1507 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:48.418678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-7704cdb1-478c-44cd-899b-7e382cfb5e47 req-1d9c6beb-3ea0-47cf-90e9-83baecaff6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c789ef3c-a649-4967-a49e-e8ce958cc666", "tag": "faa98708-0963-4cbe-98f1-6a55b7e5c07d"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:48.478007 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7704cdb1-478c-44cd-899b-7e382cfb5e47 req-1d9c6beb-3ea0-47cf-90e9-83baecaff6c3 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:48.482955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7704cdb1-478c-44cd-899b-7e382cfb5e47 req-1d9c6beb-3ea0-47cf-90e9-83baecaff6c3 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:48.484177 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7704cdb1-478c-44cd-899b-7e382cfb5e47 req-1d9c6beb-3ea0-47cf-90e9-83baecaff6c3 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:48.540204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-7704cdb1-478c-44cd-899b-7e382cfb5e47 req-1d9c6beb-3ea0-47cf-90e9-83baecaff6c3 service nova] Creating event network-changed:faa98708-0963-4cbe-98f1-6a55b7e5c07d for instance c789ef3c-a649-4967-a49e-e8ce958cc666 on hv-cinder-85032 Aug 23 22:30:48.550634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-7704cdb1-478c-44cd-899b-7e382cfb5e47 req-1d9c6beb-3ea0-47cf-90e9-83baecaff6c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137631 Aug 23 22:30:48.552847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 467/795] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:48.572135 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-b69e8599-44ac-4607-914e-b4a65fc1aed4 req-177736e1-c553-4d85-9f52-821dfab511ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b06356-525c-4c7f-9b5a-f9d0424f9dba", "name": "network-vif-deleted", "tag": "29e126aa-d7f5-470c-b76d-c8d4bd7e7849"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:48.595229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-b69e8599-44ac-4607-914e-b4a65fc1aed4 req-177736e1-c553-4d85-9f52-821dfab511ab service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:48.597145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-b69e8599-44ac-4607-914e-b4a65fc1aed4 req-177736e1-c553-4d85-9f52-821dfab511ab service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:48.598153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-b69e8599-44ac-4607-914e-b4a65fc1aed4 req-177736e1-c553-4d85-9f52-821dfab511ab service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:48.646100 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-b69e8599-44ac-4607-914e-b4a65fc1aed4 req-177736e1-c553-4d85-9f52-821dfab511ab service nova] Creating event network-vif-deleted:29e126aa-d7f5-470c-b76d-c8d4bd7e7849 for instance 61b06356-525c-4c7f-9b5a-f9d0424f9dba on hv-cinder-85032 Aug 23 22:30:48.662346 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-b69e8599-44ac-4607-914e-b4a65fc1aed4 req-177736e1-c553-4d85-9f52-821dfab511ab service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105728 Aug 23 22:30:48.663639 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 468/796] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:49.396844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-15fb109d-d3c4-4a59-a00d-877069b7b786 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:49.398973 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-15fb109d-d3c4-4a59-a00d-877069b7b786 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:49.434576 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15fb109d-d3c4-4a59-a00d-877069b7b786 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:49.442769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15fb109d-d3c4-4a59-a00d-877069b7b786 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:49.442769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15fb109d-d3c4-4a59-a00d-877069b7b786 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:49.442769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15fb109d-d3c4-4a59-a00d-877069b7b786 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:49.442769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15fb109d-d3c4-4a59-a00d-877069b7b786 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:49.449172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-15fb109d-d3c4-4a59-a00d-877069b7b786 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:49.599104 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-15fb109d-d3c4-4a59-a00d-877069b7b786 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:49.624324 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-15fb109d-d3c4-4a59-a00d-877069b7b786 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1465 microversion: 2.1 time: 0.241820 Aug 23 22:30:49.625703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 469/797] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:49 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1465 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:50.807898 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ed59b106-bcf3-4388-8f86-0156adae83d6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Action: 'create', calling method: .version_select at 0x7f901fe6e550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-861876496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkXzz+TI/eC8varspSUsuDoxgd5xTd0hcEm13etxu4MShrf0o0X8Lftxo0HPGPCx6v+bQA2VwegrZl+ABnwGtty6P64yZy2ZOwy/7KtAjfENhymk3j4+dcz3jl+2a/x2g=="}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:50.899292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-ed59b106-bcf3-4388-8f86-0156adae83d6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Getting quotas for project 77cc91a5c0bc4e5888460d7618594895. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:30:50.925580 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-ed59b106-bcf3-4388-8f86-0156adae83d6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Getting quotas for user fa949e48248747369eefd74280441b75 and project 77cc91a5c0bc4e5888460d7618594895. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:30:51.044369 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ed59b106-bcf3-4388-8f86-0156adae83d6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.832435 Aug 23 22:30:51.047979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 470/798] 10.222.0.88 () {60 vars in 1159 bytes} [Tue Aug 23 22:30:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:51.098940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:51.099995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:51.154786 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:51.164299 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:51.167146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:51.172933 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:51.178129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:51.182100 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:51.348215 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:51.349084 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:51.349858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:51.350702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lazy-loading 'fault' on Instance uuid 61b06356-525c-4c7f-9b5a-f9d0424f9dba {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:30:51.563610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:51.611940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-014bfdc5-af3b-4741-b842-5dd481a92832 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 200 len: 1311 microversion: 2.1 time: 0.559361 Aug 23 22:30:51.621721 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 471/799] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:51 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 1311 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:52.670351 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:52.671936 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 61b06356-525c-4c7f-9b5a-f9d0424f9dba] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:52.690531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:52.691952 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:52.693258 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:52.697957 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:52.699405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:52.700579 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:52.735715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] HTTP exception thrown: Instance 61b06356-525c-4c7f-9b5a-f9d0424f9dba could not be found. Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Request method failure captured: Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba HTTP/1.1 Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOv13_MU_50s_aHvDIST8LDnTZeNLrXoKO_9tRpymYOQxPByczIdikrorzz5bnQJNXBXY2DsLSgLVa6dVPKD_ZD2k345A6vw_H8htZmqauzwSRk2seRexlxlvlsqvtICY93c2IqIF6AlW97HMPeU9BZNrOrD_PqMIc0CmBjXZp0CDg Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 1dfc84dc05d542d987194096f3b7e51a Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:30:52.739749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1dfc84dc05d542d987194096f3b7e51a"}]}] Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 1dfc84dc05d542d987194096f3b7e51a Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-ServerRescueNegativeTestJSON-146746916-project Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 78b05a538ce0466ea8b3e27a0a6fc162 Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-ServerRescueNegativeTestJSON-146746916-project Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 61b06356-525c-4c7f-9b5a-f9d0424f9dba could not be found. Aug 23 22:30:52.741987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '61b06356-525c-4c7f-9b5a-f9d0424f9dba'} Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61b06356-525c-4c7f-9b5a-f9d0424f9dba could not be found. Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:30:52.742910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61b06356-525c-4c7f-9b5a-f9d0424f9dba could not be found. Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61b06356-525c-4c7f-9b5a-f9d0424f9dba could not be found. Aug 23 22:30:52.744423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:30:52.748396 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Returning 404 to user: Instance 61b06356-525c-4c7f-9b5a-f9d0424f9dba could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:30:52.748396 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-86ee956f-9d48-49aa-9204-910989765ad5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba" status: 404 len: 111 microversion: 2.1 time: 0.086717 Aug 23 22:30:52.748754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 472/800] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:52 2022] GET /compute/v2.1/servers/61b06356-525c-4c7f-9b5a-f9d0424f9dba => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:30:52.757664 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f50200b2-cceb-4355-8c66-7bf41b7f7114 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:52.758901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f50200b2-cceb-4355-8c66-7bf41b7f7114 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:52.774008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f50200b2-cceb-4355-8c66-7bf41b7f7114 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:52.774529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f50200b2-cceb-4355-8c66-7bf41b7f7114 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:52.775150 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f50200b2-cceb-4355-8c66-7bf41b7f7114 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:52.776496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f50200b2-cceb-4355-8c66-7bf41b7f7114 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:52.777392 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f50200b2-cceb-4355-8c66-7bf41b7f7114 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:52.778178 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f50200b2-cceb-4355-8c66-7bf41b7f7114 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:52.829580 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f50200b2-cceb-4355-8c66-7bf41b7f7114 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:30:52.950888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:53.032866 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f50200b2-cceb-4355-8c66-7bf41b7f7114 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "DELETE /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 204 len: 0 microversion: 2.1 time: 0.280882 Aug 23 22:30:53.037249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 473/801] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:30:52 2022] DELETE /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:30:53.054638 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7b9c5f77-ab60-4bfb-a2a6-4c18e9f06735 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:53.057438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7b9c5f77-ab60-4bfb-a2a6-4c18e9f06735 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:53.072538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b9c5f77-ab60-4bfb-a2a6-4c18e9f06735 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:53.074041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b9c5f77-ab60-4bfb-a2a6-4c18e9f06735 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:53.075211 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b9c5f77-ab60-4bfb-a2a6-4c18e9f06735 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:53.080955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b9c5f77-ab60-4bfb-a2a6-4c18e9f06735 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:53.082565 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b9c5f77-ab60-4bfb-a2a6-4c18e9f06735 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:53.085734 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7b9c5f77-ab60-4bfb-a2a6-4c18e9f06735 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:53.419461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7b9c5f77-ab60-4bfb-a2a6-4c18e9f06735 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:53.438509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7b9c5f77-ab60-4bfb-a2a6-4c18e9f06735 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.394695 Aug 23 22:30:53.440309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 474/802] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:53 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:54.094220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0242d63a-6d76-43c7-afd6-dbd46d3ac598 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:54.094220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0242d63a-6d76-43c7-afd6-dbd46d3ac598 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:54.119706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0242d63a-6d76-43c7-afd6-dbd46d3ac598 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:54.120365 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0242d63a-6d76-43c7-afd6-dbd46d3ac598 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:54.120928 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0242d63a-6d76-43c7-afd6-dbd46d3ac598 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:54.122066 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0242d63a-6d76-43c7-afd6-dbd46d3ac598 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:54.122773 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0242d63a-6d76-43c7-afd6-dbd46d3ac598 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:54.125946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0242d63a-6d76-43c7-afd6-dbd46d3ac598 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:54.181964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0242d63a-6d76-43c7-afd6-dbd46d3ac598 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/ips" status: 200 len: 148 microversion: 2.1 time: 0.102375 Aug 23 22:30:54.183516 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 475/803] 10.222.0.88 () {58 vars in 1248 bytes} [Tue Aug 23 22:30:54 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/ips => generated 148 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:54.504592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a294adb7-d570-4267-aa6c-7abd172c01ee tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:54.514041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a294adb7-d570-4267-aa6c-7abd172c01ee tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:54.536621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a294adb7-d570-4267-aa6c-7abd172c01ee tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:54.537550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a294adb7-d570-4267-aa6c-7abd172c01ee tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:54.538186 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a294adb7-d570-4267-aa6c-7abd172c01ee tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:54.539561 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a294adb7-d570-4267-aa6c-7abd172c01ee tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:54.540455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a294adb7-d570-4267-aa6c-7abd172c01ee tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:54.541012 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a294adb7-d570-4267-aa6c-7abd172c01ee tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:55.036104 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a294adb7-d570-4267-aa6c-7abd172c01ee tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:55.071446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a294adb7-d570-4267-aa6c-7abd172c01ee tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.595648 Aug 23 22:30:55.090774 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 476/804] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:54 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:56.108452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-22323f8c-c42e-42c8-980e-118814079600 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:56.109570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-22323f8c-c42e-42c8-980e-118814079600 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:56.122691 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-22323f8c-c42e-42c8-980e-118814079600 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:56.123909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-22323f8c-c42e-42c8-980e-118814079600 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:56.125191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-22323f8c-c42e-42c8-980e-118814079600 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:56.127212 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-22323f8c-c42e-42c8-980e-118814079600 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:56.128375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-22323f8c-c42e-42c8-980e-118814079600 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:56.130404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-22323f8c-c42e-42c8-980e-118814079600 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:56.516863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-22323f8c-c42e-42c8-980e-118814079600 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:56.532949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-22323f8c-c42e-42c8-980e-118814079600 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1521 microversion: 2.1 time: 0.428918 Aug 23 22:30:56.532949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 477/805] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:56 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:30:56.542335 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-25a2d9ac-b6e0-4aa5-a005-d2d38a466cd8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "129aca81-32ef-49d6-a2a7-54530c559594"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:56.546901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-25a2d9ac-b6e0-4aa5-a005-d2d38a466cd8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:56.578004 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25a2d9ac-b6e0-4aa5-a005-d2d38a466cd8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:56.579216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25a2d9ac-b6e0-4aa5-a005-d2d38a466cd8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:56.581737 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25a2d9ac-b6e0-4aa5-a005-d2d38a466cd8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:56.583319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25a2d9ac-b6e0-4aa5-a005-d2d38a466cd8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:56.584397 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25a2d9ac-b6e0-4aa5-a005-d2d38a466cd8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:56.585534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-25a2d9ac-b6e0-4aa5-a005-d2d38a466cd8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:57.418001 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-25a2d9ac-b6e0-4aa5-a005-d2d38a466cd8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881822 Aug 23 22:30:57.420888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 478/806] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:30:56 2022] POST /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:57.445667 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-7eee0af1-6d33-445a-8069-6ac7fcdde64c req-de033a13-378a-4a32-ad34-84265269aae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "498d6e2f-6d66-4925-8f7c-eca5b08c1025", "name": "network-vif-deleted", "tag": "3da5a208-32b6-480a-96ee-d5e85aa6ca75"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:30:57.468450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7eee0af1-6d33-445a-8069-6ac7fcdde64c req-de033a13-378a-4a32-ad34-84265269aae4 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:57.469538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7eee0af1-6d33-445a-8069-6ac7fcdde64c req-de033a13-378a-4a32-ad34-84265269aae4 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:57.474915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7eee0af1-6d33-445a-8069-6ac7fcdde64c req-de033a13-378a-4a32-ad34-84265269aae4 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:57.495937 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-7eee0af1-6d33-445a-8069-6ac7fcdde64c req-de033a13-378a-4a32-ad34-84265269aae4 service nova] Creating event network-vif-deleted:3da5a208-32b6-480a-96ee-d5e85aa6ca75 for instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 on hv-cinder-85032 Aug 23 22:30:57.505391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-7eee0af1-6d33-445a-8069-6ac7fcdde64c req-de033a13-378a-4a32-ad34-84265269aae4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075040 Aug 23 22:30:57.507441 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 479/807] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:30:57.585224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:57.587648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:57.599273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:57.600176 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:57.601172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:57.602147 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:57.602921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:57.603907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:57.660304 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:57.660886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:57.661410 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:57.663023 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lazy-loading 'fault' on Instance uuid 498d6e2f-6d66-4925-8f7c-eca5b08c1025 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:30:57.752737 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:57.768406 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-861fee0d-afc8-46f5-a895-1aa0f592538a tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1311 microversion: 2.1 time: 0.193304 Aug 23 22:30:57.776433 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 480/808] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:57 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1311 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:30:58.809950 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:58.811036 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:30:58.820465 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:58.820958 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:58.821439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:58.822854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:58.823550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:58.824024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:58.878229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:30:58.879066 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:30:58.879646 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:30:58.880314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lazy-loading 'fault' on Instance uuid 498d6e2f-6d66-4925-8f7c-eca5b08c1025 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:30:58.934414 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:30:58.948626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4ef8c073-1753-434d-9907-459c4f2be6f5 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1311 microversion: 2.1 time: 0.146738 Aug 23 22:30:58.949714 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 481/809] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:58 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:30:59.984234 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:30:59.985393 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:00.006384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:00.007246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:00.008034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:00.009612 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:00.010534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:00.011701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:00.067716 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:00.080818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:00.080818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:00.080818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:00.080818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lazy-loading 'fault' on Instance uuid 498d6e2f-6d66-4925-8f7c-eca5b08c1025 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:31:00.146158 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b05a538ce0466ea8b3e27a0a6fc162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfc84dc05d542d987194096f3b7e51a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:00.169303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0ab52180-6a8c-45e5-b04b-05e9574d873d tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 200 len: 1311 microversion: 2.1 time: 0.190376 Aug 23 22:31:00.170831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 482/810] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:30:59 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 1311 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:01.200986 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:01.202217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] [instance: 498d6e2f-6d66-4925-8f7c-eca5b08c1025] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:01.206079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:01.217206 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:01.218112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:01.218913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:01.220218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:01.221219 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:01.222007 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:01.251073 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] HTTP exception thrown: Instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 could not be found. Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Request method failure captured: Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 HTTP/1.1 Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOv13_MU_50s_aHvDIST8LDnTZeNLrXoKO_9tRpymYOQxPByczIdikrorzz5bnQJNXBXY2DsLSgLVa6dVPKD_ZD2k345A6vw_H8htZmqauzwSRk2seRexlxlvlsqvtICY93c2IqIF6AlW97HMPeU9BZNrOrD_PqMIc0CmBjXZp0CDg Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 1dfc84dc05d542d987194096f3b7e51a Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:31:01.254880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1dfc84dc05d542d987194096f3b7e51a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1dfc84dc05d542d987194096f3b7e51a"}]}] Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 1dfc84dc05d542d987194096f3b7e51a Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-146746916 Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-ServerRescueNegativeTestJSON-146746916-project Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 78b05a538ce0466ea8b3e27a0a6fc162 Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-ServerRescueNegativeTestJSON-146746916-project Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 could not be found. Aug 23 22:31:01.257530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '498d6e2f-6d66-4925-8f7c-eca5b08c1025'} Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 could not be found. Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:01.258982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 could not be found. Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 could not be found. Aug 23 22:31:01.261128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:01.262772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] Returning 404 to user: Instance 498d6e2f-6d66-4925-8f7c-eca5b08c1025 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:01.262772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-21b1181c-d3d7-43c2-9a1c-a07a99e3f961 tempest-ServerRescueNegativeTestJSON-146746916 tempest-ServerRescueNegativeTestJSON-146746916-project] 10.222.0.88 "GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025" status: 404 len: 111 microversion: 2.1 time: 0.063883 Aug 23 22:31:01.262772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 483/811] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:01 2022] GET /compute/v2.1/servers/498d6e2f-6d66-4925-8f7c-eca5b08c1025 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:31:08.757272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "129aca81-32ef-49d6-a2a7-54530c559594"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:08.761931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:08.774308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:08.775195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:08.776026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:08.777381 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:08.778257 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:08.779401 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:08.959983 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Invalid volume: volume 129aca81-32ef-49d6-a2a7-54530c559594 is already attached to instances: c789ef3c-a649-4967-a49e-e8ce958cc666 Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: POST /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments HTTP/1.1 Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 74 Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:31:08.962682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {"volumeAttachment": {"volumeId": "129aca81-32ef-49d6-a2a7-54530c559594"}} Aug 23 22:31:08.964546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Invalid volume: volume 129aca81-32ef-49d6-a2a7-54530c559594 is already attached to instances: c789ef3c-a649-4967-a49e-e8ce958cc666 Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'server_id': 'c789ef3c-a649-4967-a49e-e8ce958cc666', 'body': {'volumeAttachment': {'volumeId': '129aca81-32ef-49d6-a2a7-54530c559594'}}} Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 129aca81-32ef-49d6-a2a7-54530c559594 is already attached to instances: c789ef3c-a649-4967-a49e-e8ce958cc666 Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:08.966964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 129aca81-32ef-49d6-a2a7-54530c559594 is already attached to instances: c789ef3c-a649-4967-a49e-e8ce958cc666 Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:08.969468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:08.972210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:08.972210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:08.972210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:08.972210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 129aca81-32ef-49d6-a2a7-54530c559594 is already attached to instances: c789ef3c-a649-4967-a49e-e8ce958cc666 Aug 23 22:31:08.972210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:08.974738 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 400 to user: Invalid volume: volume 129aca81-32ef-49d6-a2a7-54530c559594 is already attached to instances: c789ef3c-a649-4967-a49e-e8ce958cc666 {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:08.975724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-334f56c4-4c24-4aef-a894-c4a8182c3a91 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.226139 Aug 23 22:31:08.976339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 484/812] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:31:08 2022] POST /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments => generated 174 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 22:31:09.078527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2dfb8e39-0ca9-452f-9fad-7e13db7695ac tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:09.082498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2dfb8e39-0ca9-452f-9fad-7e13db7695ac tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:09.094768 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dfb8e39-0ca9-452f-9fad-7e13db7695ac tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:09.096058 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dfb8e39-0ca9-452f-9fad-7e13db7695ac tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:09.097414 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dfb8e39-0ca9-452f-9fad-7e13db7695ac tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:09.098478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dfb8e39-0ca9-452f-9fad-7e13db7695ac tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:09.099195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dfb8e39-0ca9-452f-9fad-7e13db7695ac tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:09.099808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dfb8e39-0ca9-452f-9fad-7e13db7695ac tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:09.193796 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-2dfb8e39-0ca9-452f-9fad-7e13db7695ac tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lazy-loading 'services' on Instance uuid c789ef3c-a649-4967-a49e-e8ce958cc666 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:31:09.293916 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2dfb8e39-0ca9-452f-9fad-7e13db7695ac tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments/129aca81-32ef-49d6-a2a7-54530c559594" status: 202 len: 0 microversion: 2.1 time: 0.226215 Aug 23 22:31:09.295428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 485/813] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:31:09 2022] DELETE /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments/129aca81-32ef-49d6-a2a7-54530c559594 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:31:09.313277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-71828563-037c-4305-87a3-b9a406bdb9cc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:09.318686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-71828563-037c-4305-87a3-b9a406bdb9cc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:09.330606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-71828563-037c-4305-87a3-b9a406bdb9cc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:09.331502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-71828563-037c-4305-87a3-b9a406bdb9cc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:09.332065 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-71828563-037c-4305-87a3-b9a406bdb9cc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:09.332780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-71828563-037c-4305-87a3-b9a406bdb9cc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:09.333306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-71828563-037c-4305-87a3-b9a406bdb9cc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:09.334057 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-71828563-037c-4305-87a3-b9a406bdb9cc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:09.380807 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-71828563-037c-4305-87a3-b9a406bdb9cc tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075834 Aug 23 22:31:09.381409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 486/814] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:31:09 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:10.402305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-49602449-833d-4814-b49f-022f686e68d9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:10.407293 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-49602449-833d-4814-b49f-022f686e68d9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:10.420732 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-49602449-833d-4814-b49f-022f686e68d9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:10.421924 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-49602449-833d-4814-b49f-022f686e68d9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:10.423238 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-49602449-833d-4814-b49f-022f686e68d9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:10.424771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-49602449-833d-4814-b49f-022f686e68d9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:10.426000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-49602449-833d-4814-b49f-022f686e68d9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:10.428042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-49602449-833d-4814-b49f-022f686e68d9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:10.499152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-49602449-833d-4814-b49f-022f686e68d9 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105726 Aug 23 22:31:10.501153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 487/815] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:31:10 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:11.518569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a40d51c3-65a1-406b-a26f-2703cd26fcc2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:11.520867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a40d51c3-65a1-406b-a26f-2703cd26fcc2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:11.527734 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a40d51c3-65a1-406b-a26f-2703cd26fcc2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:11.528218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a40d51c3-65a1-406b-a26f-2703cd26fcc2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:11.528648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a40d51c3-65a1-406b-a26f-2703cd26fcc2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:11.529378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a40d51c3-65a1-406b-a26f-2703cd26fcc2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:11.529824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a40d51c3-65a1-406b-a26f-2703cd26fcc2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:11.530249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a40d51c3-65a1-406b-a26f-2703cd26fcc2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:11.564272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a40d51c3-65a1-406b-a26f-2703cd26fcc2 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055397 Aug 23 22:31:11.565401 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 488/816] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:31:11 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 22:31:11.634979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0f077342-5013-4163-96f3-1fbb8a3ceef6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:11.636242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0f077342-5013-4163-96f3-1fbb8a3ceef6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:11.644721 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f077342-5013-4163-96f3-1fbb8a3ceef6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:11.645401 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f077342-5013-4163-96f3-1fbb8a3ceef6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:11.646256 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f077342-5013-4163-96f3-1fbb8a3ceef6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:11.647027 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f077342-5013-4163-96f3-1fbb8a3ceef6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:11.647522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f077342-5013-4163-96f3-1fbb8a3ceef6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:11.647962 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0f077342-5013-4163-96f3-1fbb8a3ceef6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:11.653720 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:11.690641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0f077342-5013-4163-96f3-1fbb8a3ceef6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:31:11.795309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0f077342-5013-4163-96f3-1fbb8a3ceef6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 204 len: 0 microversion: 2.1 time: 0.164063 Aug 23 22:31:11.801849 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 489/817] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:31:11 2022] DELETE /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:31:11.810485 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-085fcee0-380d-448c-90e2-9a08209c805e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:11.811368 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-085fcee0-380d-448c-90e2-9a08209c805e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:11.819269 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-085fcee0-380d-448c-90e2-9a08209c805e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:11.819845 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-085fcee0-380d-448c-90e2-9a08209c805e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:11.820436 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-085fcee0-380d-448c-90e2-9a08209c805e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:11.821413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-085fcee0-380d-448c-90e2-9a08209c805e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:11.821888 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-085fcee0-380d-448c-90e2-9a08209c805e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:11.822460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-085fcee0-380d-448c-90e2-9a08209c805e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:12.008826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-085fcee0-380d-448c-90e2-9a08209c805e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:12.022179 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-085fcee0-380d-448c-90e2-9a08209c805e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1681 microversion: 2.1 time: 0.216926 Aug 23 22:31:12.022863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 490/818] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:11 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:13.045818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-137f0700-c35d-4e98-a149-38a7596dc93e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:13.046587 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-137f0700-c35d-4e98-a149-38a7596dc93e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:13.056052 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137f0700-c35d-4e98-a149-38a7596dc93e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:13.057169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137f0700-c35d-4e98-a149-38a7596dc93e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:13.057772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137f0700-c35d-4e98-a149-38a7596dc93e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:13.058491 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137f0700-c35d-4e98-a149-38a7596dc93e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:13.059332 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137f0700-c35d-4e98-a149-38a7596dc93e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:13.059634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137f0700-c35d-4e98-a149-38a7596dc93e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:13.216456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-137f0700-c35d-4e98-a149-38a7596dc93e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:13.227158 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-137f0700-c35d-4e98-a149-38a7596dc93e tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1681 microversion: 2.1 time: 0.185383 Aug 23 22:31:13.228392 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 491/819] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:13 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:14.251342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-87d8a0ab-4c22-493e-a953-f2c88230e928 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:14.252266 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-87d8a0ab-4c22-493e-a953-f2c88230e928 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:14.258821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d8a0ab-4c22-493e-a953-f2c88230e928 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:14.259312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d8a0ab-4c22-493e-a953-f2c88230e928 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:14.259753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d8a0ab-4c22-493e-a953-f2c88230e928 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:14.260472 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d8a0ab-4c22-493e-a953-f2c88230e928 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:14.260924 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d8a0ab-4c22-493e-a953-f2c88230e928 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:14.261601 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-87d8a0ab-4c22-493e-a953-f2c88230e928 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:14.514563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-87d8a0ab-4c22-493e-a953-f2c88230e928 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:14.523417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-87d8a0ab-4c22-493e-a953-f2c88230e928 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1681 microversion: 2.1 time: 0.276003 Aug 23 22:31:14.524005 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 492/820] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:14 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:14.988506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1220355370", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-861876496", "security_groups": [{"name": "tempest-secgroup-smoke-297031976"}], "block_device_mapping_v2": [{"uuid": "2462d48a-408f-489b-975c-b24b6536a23b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd15f43b-dcfe-4caf-8228-7089e7287c38"}]}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:15.140823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] validate_networks() for [('dd15f43b-dcfe-4caf-8228-7089e7287c38', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:31:15.944155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:31:15.945005 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:31:15.945210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:31:15.945488 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:31:15.945905 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:31:15.961700 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:15.962586 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:15.963628 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:15.965001 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:15.965871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:15.966678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:16.001834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Getting quotas for project 77cc91a5c0bc4e5888460d7618594895. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:31:16.009804 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Getting quotas for user fa949e48248747369eefd74280441b75 and project 77cc91a5c0bc4e5888460d7618594895. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:31:16.100855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:31:16.103190 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2462d48a-408f-489b-975c-b24b6536a23b',volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:31:16.350997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1b9a5c54-7803-46f9-a533-48b6acd305b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.368981 Aug 23 22:31:16.352136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 493/821] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:31:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:31:16.358638 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:16.359772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:16.369706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:16.370688 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:16.371699 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:16.372570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:16.373356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:16.374013 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:16.432452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:16.433160 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:16.433733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:16.434298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lazy-loading 'fault' on Instance uuid c789ef3c-a649-4967-a49e-e8ce958cc666 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:31:16.515287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:16.530875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6683f4b5-365b-4427-8e95-6cd1290b18e4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 200 len: 1332 microversion: 2.1 time: 0.177223 Aug 23 22:31:16.545191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 494/822] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:16 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 1332 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:16.545191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-76fcca67-2e6f-4082-93d6-b7b6beaf0f47 req-7b2d4160-3981-4670-ad7a-45ddb7420af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c789ef3c-a649-4967-a49e-e8ce958cc666", "name": "network-vif-deleted", "tag": "faa98708-0963-4cbe-98f1-6a55b7e5c07d"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:16.561323 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-76fcca67-2e6f-4082-93d6-b7b6beaf0f47 req-7b2d4160-3981-4670-ad7a-45ddb7420af1 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:16.562129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-76fcca67-2e6f-4082-93d6-b7b6beaf0f47 req-7b2d4160-3981-4670-ad7a-45ddb7420af1 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:16.563169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-76fcca67-2e6f-4082-93d6-b7b6beaf0f47 req-7b2d4160-3981-4670-ad7a-45ddb7420af1 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:16.588180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-76fcca67-2e6f-4082-93d6-b7b6beaf0f47 req-7b2d4160-3981-4670-ad7a-45ddb7420af1 service nova] Creating event network-vif-deleted:faa98708-0963-4cbe-98f1-6a55b7e5c07d for instance c789ef3c-a649-4967-a49e-e8ce958cc666 on hv-cinder-85032 Aug 23 22:31:16.599649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-76fcca67-2e6f-4082-93d6-b7b6beaf0f47 req-7b2d4160-3981-4670-ad7a-45ddb7420af1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064232 Aug 23 22:31:16.601561 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 495/823] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:16.619567 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cc02ce33-c929-4f6d-9353-2f957c1b9d85 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:16.620881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cc02ce33-c929-4f6d-9353-2f957c1b9d85 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:16.714133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-cc02ce33-c929-4f6d-9353-2f957c1b9d85 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:16.724693 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cc02ce33-c929-4f6d-9353-2f957c1b9d85 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1094 microversion: 2.1 time: 0.121305 Aug 23 22:31:16.725794 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 496/824] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:16 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1094 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:17.568024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:17.569123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:17.577465 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:17.578104 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:17.578577 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:17.580119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:17.580716 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:17.581377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:17.609298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 HTTP/1.1 Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:31:17.613169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:31:17.614976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'c789ef3c-a649-4967-a49e-e8ce958cc666'} Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:17.615891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:31:17.618550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:17.620105 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:17.620105 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e81f217e-c41e-4fdb-9dc6-5c41523353be tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 404 len: 111 microversion: 2.1 time: 0.052272 Aug 23 22:31:17.620105 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 497/825] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:17 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:31:17.631178 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e4168243-e092-46a3-b6f2-d71a6ad0352f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '.version_select at 0x7f902c0c75e0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:17.663697 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e4168243-e092-46a3-b6f2-d71a6ad0352f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451863157" status: 202 len: 0 microversion: 2.1 time: 0.040927 Aug 23 22:31:17.664404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 498/826] 10.222.0.88 () {58 vars in 1221 bytes} [Tue Aug 23 22:31:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451863157 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:31:17.753165 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-88de3927-85c3-42d0-ada7-7ddd34d8e44d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:17.754159 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-88de3927-85c3-42d0-ada7-7ddd34d8e44d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:17.762792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88de3927-85c3-42d0-ada7-7ddd34d8e44d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:17.763707 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88de3927-85c3-42d0-ada7-7ddd34d8e44d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:17.764500 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88de3927-85c3-42d0-ada7-7ddd34d8e44d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:17.765505 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88de3927-85c3-42d0-ada7-7ddd34d8e44d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:17.766071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88de3927-85c3-42d0-ada7-7ddd34d8e44d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:17.766714 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-88de3927-85c3-42d0-ada7-7ddd34d8e44d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:17.859100 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-88de3927-85c3-42d0-ada7-7ddd34d8e44d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:17.868566 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-88de3927-85c3-42d0-ada7-7ddd34d8e44d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1192 microversion: 2.1 time: 0.121314 Aug 23 22:31:17.869526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 499/827] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:17 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1192 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:18.574792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-097cbcf9-564f-491a-8833-6e4005585e32 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: .version_select at 0x7f902c0df430>, body: {"keypair": {"name": "tempest-keypair-13725971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi+TzNdYt4Fb/G6tupHyVCx+MZjfs+O5lrqi6Rtgbm5oRklsAUlspArUy0WDZZ6gA3yDUTDuc5/NKhcEpDu6iZzW1/bqSRJkQLPItXFG81KhKcrUO6tuxM5MG9ZJDmxBw=="}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:18.597934 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-097cbcf9-564f-491a-8833-6e4005585e32 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for project c0fc1c15f821495e9883814ffc7aed78. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:31:18.602714 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-097cbcf9-564f-491a-8833-6e4005585e32 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for user 1db1a9a77be6452991ec4f99af814e7a and project c0fc1c15f821495e9883814ffc7aed78. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:31:18.630848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-097cbcf9-564f-491a-8833-6e4005585e32 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.059847 Aug 23 22:31:18.631746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 500/828] 10.222.0.88 () {60 vars in 1159 bytes} [Tue Aug 23 22:31:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:18.901153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-70711ca6-3157-49a7-86fb-9c574bd5308f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:18.902201 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-70711ca6-3157-49a7-86fb-9c574bd5308f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:18.912981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70711ca6-3157-49a7-86fb-9c574bd5308f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:18.913943 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70711ca6-3157-49a7-86fb-9c574bd5308f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:18.914738 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70711ca6-3157-49a7-86fb-9c574bd5308f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:18.916088 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70711ca6-3157-49a7-86fb-9c574bd5308f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:18.916957 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70711ca6-3157-49a7-86fb-9c574bd5308f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:18.918084 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70711ca6-3157-49a7-86fb-9c574bd5308f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:19.003317 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-70711ca6-3157-49a7-86fb-9c574bd5308f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:19.013727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-70711ca6-3157-49a7-86fb-9c574bd5308f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1192 microversion: 2.1 time: 0.119079 Aug 23 22:31:19.022296 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 501/829] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:18 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1192 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:20.037922 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c47743c5-58c1-4985-b0b1-e02091e88de8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:20.038722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c47743c5-58c1-4985-b0b1-e02091e88de8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:20.045490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c47743c5-58c1-4985-b0b1-e02091e88de8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:20.045984 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c47743c5-58c1-4985-b0b1-e02091e88de8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:20.046416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c47743c5-58c1-4985-b0b1-e02091e88de8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:20.047128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c47743c5-58c1-4985-b0b1-e02091e88de8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:20.047580 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c47743c5-58c1-4985-b0b1-e02091e88de8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:20.048848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c47743c5-58c1-4985-b0b1-e02091e88de8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:20.152914 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c47743c5-58c1-4985-b0b1-e02091e88de8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:20.169246 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c47743c5-58c1-4985-b0b1-e02091e88de8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1192 microversion: 2.1 time: 0.135113 Aug 23 22:31:20.183664 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 502/830] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:20 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1192 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:20.351086 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1508982799", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c01e5e5-25ba-44de-af70-328d6d292257"}], "security_groups": [{"name": "tempest-securitygroup--371234432"}], "key_name": "tempest-keypair-13725971", "user_data": "}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:20.509478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] validate_networks() for [('4c01e5e5-25ba-44de-af70-328d6d292257', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:31:21.238443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:31:21.239168 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:31:21.240043 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:31:21.240823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:31:21.241687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:31:21.258027 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:21.258985 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:21.259815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:21.260954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:21.261538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:21.262220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:21.299938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for project c0fc1c15f821495e9883814ffc7aed78. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:31:21.307488 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Getting quotas for user 1db1a9a77be6452991ec4f99af814e7a and project c0fc1c15f821495e9883814ffc7aed78. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:31:21.328584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:31:21.332815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:31:21.423223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a105d719-b9dd-4e18-8b61-3802703ba05c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.085583 Aug 23 22:31:21.424380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 503/831] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:31:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:31:21.433803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a00df4d0-663f-48d7-8e78-3c05eda1a6e9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:21.435149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a00df4d0-663f-48d7-8e78-3c05eda1a6e9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:21.447664 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a00df4d0-663f-48d7-8e78-3c05eda1a6e9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:21.448449 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a00df4d0-663f-48d7-8e78-3c05eda1a6e9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:21.449559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a00df4d0-663f-48d7-8e78-3c05eda1a6e9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:21.450553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a00df4d0-663f-48d7-8e78-3c05eda1a6e9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:21.451341 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a00df4d0-663f-48d7-8e78-3c05eda1a6e9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:21.452082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a00df4d0-663f-48d7-8e78-3c05eda1a6e9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:21.497963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a00df4d0-663f-48d7-8e78-3c05eda1a6e9 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/ips" status: 200 len: 146 microversion: 2.1 time: 0.071965 Aug 23 22:31:21.499145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 504/832] 10.222.0.88 () {58 vars in 1248 bytes} [Tue Aug 23 22:31:21 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/ips => generated 146 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:21.505921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b00126e1-fc4b-4d8b-922e-8c37a6b66228 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:21.507282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b00126e1-fc4b-4d8b-922e-8c37a6b66228 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:21.510387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:21.530684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b00126e1-fc4b-4d8b-922e-8c37a6b66228 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:21.534513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b00126e1-fc4b-4d8b-922e-8c37a6b66228 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:21.535708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b00126e1-fc4b-4d8b-922e-8c37a6b66228 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:21.539355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b00126e1-fc4b-4d8b-922e-8c37a6b66228 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:21.540486 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b00126e1-fc4b-4d8b-922e-8c37a6b66228 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:21.541499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b00126e1-fc4b-4d8b-922e-8c37a6b66228 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:21.699604 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b00126e1-fc4b-4d8b-922e-8c37a6b66228 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:21.721674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b00126e1-fc4b-4d8b-922e-8c37a6b66228 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1210 microversion: 2.1 time: 0.220656 Aug 23 22:31:21.723379 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 505/833] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:21 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1210 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:21.735492 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-33e59dd3-3ee9-4b6c-98ab-d07487fd2abb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:21.737109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-33e59dd3-3ee9-4b6c-98ab-d07487fd2abb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:21.896886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-33e59dd3-3ee9-4b6c-98ab-d07487fd2abb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:21.923866 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-33e59dd3-3ee9-4b6c-98ab-d07487fd2abb tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1240 microversion: 2.1 time: 0.186298 Aug 23 22:31:21.925042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 506/834] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:21 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1240 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:21.974963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3793a5b8-e2b1-4649-9ac6-c169c5644993 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:21.980554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3793a5b8-e2b1-4649-9ac6-c169c5644993 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:22.017723 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3793a5b8-e2b1-4649-9ac6-c169c5644993 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:22.018564 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3793a5b8-e2b1-4649-9ac6-c169c5644993 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:22.019332 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3793a5b8-e2b1-4649-9ac6-c169c5644993 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:22.028808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3793a5b8-e2b1-4649-9ac6-c169c5644993 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:22.029977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3793a5b8-e2b1-4649-9ac6-c169c5644993 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:22.030736 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3793a5b8-e2b1-4649-9ac6-c169c5644993 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:22.155763 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3793a5b8-e2b1-4649-9ac6-c169c5644993 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/ips" status: 200 len: 151 microversion: 2.20 time: 0.228894 Aug 23 22:31:22.158440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 507/835] 10.222.0.88 () {60 vars in 1289 bytes} [Tue Aug 23 22:31:21 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/ips => generated 151 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 22:31:22.760095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-137cfd4b-cd05-4b41-b046-3eb0e4c8b2fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:22.760768 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-137cfd4b-cd05-4b41-b046-3eb0e4c8b2fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:22.778217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137cfd4b-cd05-4b41-b046-3eb0e4c8b2fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:22.778797 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137cfd4b-cd05-4b41-b046-3eb0e4c8b2fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:22.781285 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137cfd4b-cd05-4b41-b046-3eb0e4c8b2fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:22.785569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137cfd4b-cd05-4b41-b046-3eb0e4c8b2fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:22.786492 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137cfd4b-cd05-4b41-b046-3eb0e4c8b2fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:22.790153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-137cfd4b-cd05-4b41-b046-3eb0e4c8b2fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:23.123641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-137cfd4b-cd05-4b41-b046-3eb0e4c8b2fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:23.133284 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-137cfd4b-cd05-4b41-b046-3eb0e4c8b2fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.380612 Aug 23 22:31:23.133906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 508/836] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:22 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:23.140399 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f1b37524-273d-4017-bd0a-4f27ac1fb76a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:23.141338 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f1b37524-273d-4017-bd0a-4f27ac1fb76a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:23.150432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1b37524-273d-4017-bd0a-4f27ac1fb76a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:23.151441 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1b37524-273d-4017-bd0a-4f27ac1fb76a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:23.152261 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1b37524-273d-4017-bd0a-4f27ac1fb76a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:23.153709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1b37524-273d-4017-bd0a-4f27ac1fb76a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:23.154532 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1b37524-273d-4017-bd0a-4f27ac1fb76a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:23.155603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1b37524-273d-4017-bd0a-4f27ac1fb76a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:23.604864 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f1b37524-273d-4017-bd0a-4f27ac1fb76a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:23.624336 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f1b37524-273d-4017-bd0a-4f27ac1fb76a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1292 microversion: 2.1 time: 0.487651 Aug 23 22:31:23.626765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 509/837] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:23 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1292 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:23.633842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-af116f1e-cfd9-4b3e-a37e-98bc2362d202 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e79d3b45-1e4b-4af7-b859-57b323d11a3b"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:23.637919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-af116f1e-cfd9-4b3e-a37e-98bc2362d202 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:23.654293 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af116f1e-cfd9-4b3e-a37e-98bc2362d202 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:23.654902 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af116f1e-cfd9-4b3e-a37e-98bc2362d202 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:23.655416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af116f1e-cfd9-4b3e-a37e-98bc2362d202 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:23.656281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af116f1e-cfd9-4b3e-a37e-98bc2362d202 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:23.656837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af116f1e-cfd9-4b3e-a37e-98bc2362d202 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:23.657895 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af116f1e-cfd9-4b3e-a37e-98bc2362d202 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:23.973556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:24.257418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-af116f1e-cfd9-4b3e-a37e-98bc2362d202 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627887 Aug 23 22:31:24.267836 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 510/838] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:31:23 2022] POST /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments => generated 194 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:24.284272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b8c45411-142f-4430-bfd2-9adce79e2b6c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:24.286414 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b8c45411-142f-4430-bfd2-9adce79e2b6c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:24.300395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8c45411-142f-4430-bfd2-9adce79e2b6c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:24.300546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8c45411-142f-4430-bfd2-9adce79e2b6c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:24.301452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8c45411-142f-4430-bfd2-9adce79e2b6c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:24.303739 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8c45411-142f-4430-bfd2-9adce79e2b6c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:24.316054 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8c45411-142f-4430-bfd2-9adce79e2b6c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:24.317370 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8c45411-142f-4430-bfd2-9adce79e2b6c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:25.045559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b8c45411-142f-4430-bfd2-9adce79e2b6c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:25.062093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b8c45411-142f-4430-bfd2-9adce79e2b6c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.791301 Aug 23 22:31:25.084981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 511/839] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:24 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:25.090324 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-3b0be681-4155-4ec9-9904-07d9830c3b79 req-bee45d72-31d7-4714-b933-d087eb98896c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e", "tag": "21001569-2deb-472d-899a-71203a25df1a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:25.107767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3b0be681-4155-4ec9-9904-07d9830c3b79 req-bee45d72-31d7-4714-b933-d087eb98896c service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:25.110308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3b0be681-4155-4ec9-9904-07d9830c3b79 req-bee45d72-31d7-4714-b933-d087eb98896c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:25.111969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3b0be681-4155-4ec9-9904-07d9830c3b79 req-bee45d72-31d7-4714-b933-d087eb98896c service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:25.150518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-3b0be681-4155-4ec9-9904-07d9830c3b79 req-bee45d72-31d7-4714-b933-d087eb98896c service nova] Creating event network-changed:21001569-2deb-472d-899a-71203a25df1a for instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e on hv-cinder-85032 Aug 23 22:31:25.167465 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-3b0be681-4155-4ec9-9904-07d9830c3b79 req-bee45d72-31d7-4714-b933-d087eb98896c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080675 Aug 23 22:31:25.168752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 512/840] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:25.176633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a997c41a-2c48-48e3-ac5e-c7fef775c64a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:25.178749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a997c41a-2c48-48e3-ac5e-c7fef775c64a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:25.186589 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a997c41a-2c48-48e3-ac5e-c7fef775c64a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:25.187467 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a997c41a-2c48-48e3-ac5e-c7fef775c64a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:25.188149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a997c41a-2c48-48e3-ac5e-c7fef775c64a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:25.189942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a997c41a-2c48-48e3-ac5e-c7fef775c64a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:25.190440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a997c41a-2c48-48e3-ac5e-c7fef775c64a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:25.190857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a997c41a-2c48-48e3-ac5e-c7fef775c64a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:25.221480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-a997c41a-2c48-48e3-ac5e-c7fef775c64a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lazy-loading 'flavor' on Instance uuid d84b4a2f-7ca4-4281-84ff-69efdc3897a2 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:31:25.608939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a997c41a-2c48-48e3-ac5e-c7fef775c64a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "POST /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/action" status: 202 len: 0 microversion: 2.20 time: 0.437479 Aug 23 22:31:25.611214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 513/841] 10.222.0.88 () {62 vars in 1319 bytes} [Tue Aug 23 22:31:25 2022] POST /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:31:25.622177 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-83f1ad56-2a1e-44b2-917b-3cb3c30b2e3f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:25.623518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-83f1ad56-2a1e-44b2-917b-3cb3c30b2e3f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:25.637449 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83f1ad56-2a1e-44b2-917b-3cb3c30b2e3f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:25.640115 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83f1ad56-2a1e-44b2-917b-3cb3c30b2e3f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:25.641718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83f1ad56-2a1e-44b2-917b-3cb3c30b2e3f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:25.643872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83f1ad56-2a1e-44b2-917b-3cb3c30b2e3f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:25.645701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83f1ad56-2a1e-44b2-917b-3cb3c30b2e3f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:25.646961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83f1ad56-2a1e-44b2-917b-3cb3c30b2e3f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:26.049813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-83f1ad56-2a1e-44b2-917b-3cb3c30b2e3f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:26.062856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-83f1ad56-2a1e-44b2-917b-3cb3c30b2e3f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1365 microversion: 2.1 time: 0.448839 Aug 23 22:31:26.077516 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 514/842] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:25 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:26.086556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:26.086556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:26.099715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:26.100186 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:26.100698 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:26.101668 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:26.102211 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:26.102800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:26.674015 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:26.694551 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:26.696860 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:26.698209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c609a747-2746-4e62-ae38-2333ac535302 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.619520 Aug 23 22:31:26.698877 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 515/843] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:26 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:26.704840 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-909ab118-e5d6-413e-8cef-42ca8827f5f7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:26.706433 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-909ab118-e5d6-413e-8cef-42ca8827f5f7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:26.718570 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-909ab118-e5d6-413e-8cef-42ca8827f5f7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:26.720192 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-909ab118-e5d6-413e-8cef-42ca8827f5f7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:26.720695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-909ab118-e5d6-413e-8cef-42ca8827f5f7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:26.721779 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-909ab118-e5d6-413e-8cef-42ca8827f5f7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:26.722281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-909ab118-e5d6-413e-8cef-42ca8827f5f7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:26.723004 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-909ab118-e5d6-413e-8cef-42ca8827f5f7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:27.067288 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-909ab118-e5d6-413e-8cef-42ca8827f5f7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:27.090158 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-909ab118-e5d6-413e-8cef-42ca8827f5f7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.382185 Aug 23 22:31:27.099568 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 516/844] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:26 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:27.122699 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-4acbac38-bcdb-48df-9383-3be61eee3eb7 req-caf446b4-317d-49ff-937e-00fa297db7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f17a50-b5b6-49b4-a726-04c85ea730f7", "tag": "4124fc99-9dcd-4dbc-b245-3aa44b05b837"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:27.140949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-4acbac38-bcdb-48df-9383-3be61eee3eb7 req-caf446b4-317d-49ff-937e-00fa297db7e9 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:27.142335 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-4acbac38-bcdb-48df-9383-3be61eee3eb7 req-caf446b4-317d-49ff-937e-00fa297db7e9 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:27.143060 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-4acbac38-bcdb-48df-9383-3be61eee3eb7 req-caf446b4-317d-49ff-937e-00fa297db7e9 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:27.162949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-4acbac38-bcdb-48df-9383-3be61eee3eb7 req-caf446b4-317d-49ff-937e-00fa297db7e9 service nova] Creating event network-changed:4124fc99-9dcd-4dbc-b245-3aa44b05b837 for instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 on hv-cinder-85032 Aug 23 22:31:27.172187 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-4acbac38-bcdb-48df-9383-3be61eee3eb7 req-caf446b4-317d-49ff-937e-00fa297db7e9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071107 Aug 23 22:31:27.173319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 517/845] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:27.182868 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c3b48616-8dbe-431e-98b8-9ffef35bee30 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:27.184164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c3b48616-8dbe-431e-98b8-9ffef35bee30 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:27.193962 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c3b48616-8dbe-431e-98b8-9ffef35bee30 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:27.194777 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c3b48616-8dbe-431e-98b8-9ffef35bee30 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:27.195329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c3b48616-8dbe-431e-98b8-9ffef35bee30 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:27.196533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c3b48616-8dbe-431e-98b8-9ffef35bee30 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:27.197410 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c3b48616-8dbe-431e-98b8-9ffef35bee30 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:27.198144 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c3b48616-8dbe-431e-98b8-9ffef35bee30 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:27.570487 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c3b48616-8dbe-431e-98b8-9ffef35bee30 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:27.583374 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c3b48616-8dbe-431e-98b8-9ffef35bee30 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1365 microversion: 2.1 time: 0.408225 Aug 23 22:31:27.584314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 518/846] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:27 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:27.746734 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:27.747865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:27.758947 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:27.759708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:27.760449 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:27.761736 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:27.762504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:27.763670 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:27.960762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:27.973994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:27.975808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:27.977343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8859aa9a-8639-44f1-9d84-0f492680bce5 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.237701 Aug 23 22:31:27.978032 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 519/847] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:27 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:28.119933 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b6cb7fcd-3190-49e4-9b6b-e024105505f9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:28.120710 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b6cb7fcd-3190-49e4-9b6b-e024105505f9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:28.127942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6cb7fcd-3190-49e4-9b6b-e024105505f9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.128434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6cb7fcd-3190-49e4-9b6b-e024105505f9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.128867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6cb7fcd-3190-49e4-9b6b-e024105505f9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:28.129620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6cb7fcd-3190-49e4-9b6b-e024105505f9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.130076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6cb7fcd-3190-49e4-9b6b-e024105505f9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.130501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6cb7fcd-3190-49e4-9b6b-e024105505f9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:28.320925 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b6cb7fcd-3190-49e4-9b6b-e024105505f9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:28.334990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b6cb7fcd-3190-49e4-9b6b-e024105505f9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.217366 Aug 23 22:31:28.334990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 520/848] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:28 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:28.614756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-95158e18-75fd-4a21-a25b-7bb07dc2653a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:28.615957 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-95158e18-75fd-4a21-a25b-7bb07dc2653a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:28.628263 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95158e18-75fd-4a21-a25b-7bb07dc2653a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.629160 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95158e18-75fd-4a21-a25b-7bb07dc2653a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.629971 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95158e18-75fd-4a21-a25b-7bb07dc2653a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:28.631279 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95158e18-75fd-4a21-a25b-7bb07dc2653a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:28.632117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95158e18-75fd-4a21-a25b-7bb07dc2653a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:28.633204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-95158e18-75fd-4a21-a25b-7bb07dc2653a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:29.041766 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-95158e18-75fd-4a21-a25b-7bb07dc2653a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:29.057773 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-95158e18-75fd-4a21-a25b-7bb07dc2653a tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1365 microversion: 2.1 time: 0.451326 Aug 23 22:31:29.065204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 521/849] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:28 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1365 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:29.075008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:29.076579 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:29.089729 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:29.090643 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:29.091447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:29.092652 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:29.093460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:29.094179 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:29.343149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:29.358022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:29.361114 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:29.363676 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8f5a882d-c132-476b-a0fb-078b22d9dbce tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.296085 Aug 23 22:31:29.364728 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 522/850] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:29 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:29.373250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-69610a3e-9843-4608-b6c6-b2a8cd3f578c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:29.374329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-69610a3e-9843-4608-b6c6-b2a8cd3f578c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:29.387217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69610a3e-9843-4608-b6c6-b2a8cd3f578c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:29.388276 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69610a3e-9843-4608-b6c6-b2a8cd3f578c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:29.388954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69610a3e-9843-4608-b6c6-b2a8cd3f578c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:29.390343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69610a3e-9843-4608-b6c6-b2a8cd3f578c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:29.391272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69610a3e-9843-4608-b6c6-b2a8cd3f578c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:29.392042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69610a3e-9843-4608-b6c6-b2a8cd3f578c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:29.588563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-69610a3e-9843-4608-b6c6-b2a8cd3f578c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:29.597575 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-69610a3e-9843-4608-b6c6-b2a8cd3f578c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.231358 Aug 23 22:31:29.598150 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 523/851] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:29 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:30.102061 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e0c0e866-3425-4b88-ace3-e8cd39d13f52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:30.102831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e0c0e866-3425-4b88-ace3-e8cd39d13f52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:30.111484 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0c0e866-3425-4b88-ace3-e8cd39d13f52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.112084 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0c0e866-3425-4b88-ace3-e8cd39d13f52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.112795 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0c0e866-3425-4b88-ace3-e8cd39d13f52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.113883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0c0e866-3425-4b88-ace3-e8cd39d13f52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.114464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0c0e866-3425-4b88-ace3-e8cd39d13f52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.115060 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e0c0e866-3425-4b88-ace3-e8cd39d13f52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.351301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e0c0e866-3425-4b88-ace3-e8cd39d13f52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:30.372556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e0c0e866-3425-4b88-ace3-e8cd39d13f52 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1365 microversion: 2.1 time: 0.275542 Aug 23 22:31:30.374109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 524/852] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:30 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:30.402990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:30.404308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:30.413671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.414794 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.415765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.417611 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.418833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.419690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.677464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:30.680633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:30.691072 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:30.692604 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:30.694543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4e316fb9-9c7b-4502-b25b-367d90aaf6c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.295993 Aug 23 22:31:30.695441 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 525/853] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:30 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:30.701133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-108c49e7-909c-4a3c-934a-6114bdade71c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:30.702029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-108c49e7-909c-4a3c-934a-6114bdade71c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:30.711220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-108c49e7-909c-4a3c-934a-6114bdade71c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.712069 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-108c49e7-909c-4a3c-934a-6114bdade71c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.712552 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-108c49e7-909c-4a3c-934a-6114bdade71c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.713307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-108c49e7-909c-4a3c-934a-6114bdade71c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:30.713930 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-108c49e7-909c-4a3c-934a-6114bdade71c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:30.714502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-108c49e7-909c-4a3c-934a-6114bdade71c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:30.913234 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-108c49e7-909c-4a3c-934a-6114bdade71c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:30.934868 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-108c49e7-909c-4a3c-934a-6114bdade71c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.237238 Aug 23 22:31:30.937618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 526/854] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:30 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:31.409904 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-401956a3-43e8-4902-957e-3449daa8115c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:31.410967 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-401956a3-43e8-4902-957e-3449daa8115c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:31.413106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:31.419716 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-401956a3-43e8-4902-957e-3449daa8115c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:31.420371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-401956a3-43e8-4902-957e-3449daa8115c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:31.420740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-401956a3-43e8-4902-957e-3449daa8115c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:31.421383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-401956a3-43e8-4902-957e-3449daa8115c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:31.421869 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-401956a3-43e8-4902-957e-3449daa8115c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:31.422292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-401956a3-43e8-4902-957e-3449daa8115c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:31.617519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-401956a3-43e8-4902-957e-3449daa8115c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:31.634128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-401956a3-43e8-4902-957e-3449daa8115c tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1365 microversion: 2.1 time: 0.228628 Aug 23 22:31:31.635202 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 527/855] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:31 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:31.730695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:31.732231 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:31.745623 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:31.747227 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:31.748085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:31.749395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:31.750388 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:31.751165 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:31.903686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=20 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:32.028489 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:32.045553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:32.048978 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:32.051473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4e864ed5-2127-436a-be03-31aad2e57ecc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.329081 Aug 23 22:31:32.056286 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 528/856] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:31 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:32.067754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9baf0776-aaa5-40fe-b54e-e995682f90d5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:32.070351 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9baf0776-aaa5-40fe-b54e-e995682f90d5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:32.085712 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baf0776-aaa5-40fe-b54e-e995682f90d5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.086757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baf0776-aaa5-40fe-b54e-e995682f90d5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.087536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baf0776-aaa5-40fe-b54e-e995682f90d5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.088821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baf0776-aaa5-40fe-b54e-e995682f90d5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.089708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baf0776-aaa5-40fe-b54e-e995682f90d5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.090853 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9baf0776-aaa5-40fe-b54e-e995682f90d5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.800654 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9baf0776-aaa5-40fe-b54e-e995682f90d5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:32.810311 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9baf0776-aaa5-40fe-b54e-e995682f90d5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.752865 Aug 23 22:31:32.811050 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 529/857] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:32 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:32.816926 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8d199441-e250-46da-b49a-b6a689f3ee9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:32.819719 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8d199441-e250-46da-b49a-b6a689f3ee9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:32.826934 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d199441-e250-46da-b49a-b6a689f3ee9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.827539 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d199441-e250-46da-b49a-b6a689f3ee9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.828064 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d199441-e250-46da-b49a-b6a689f3ee9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.829467 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d199441-e250-46da-b49a-b6a689f3ee9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.830128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d199441-e250-46da-b49a-b6a689f3ee9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.830786 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8d199441-e250-46da-b49a-b6a689f3ee9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.874257 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8d199441-e250-46da-b49a-b6a689f3ee9b tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061455 Aug 23 22:31:32.875529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 530/858] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:31:32 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:32.883134 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-7dc4cf00-8cac-45d0-a4b8-f52459852389 req-08280793-2ab1-430b-b30e-d8d7f26a5a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f17a50-b5b6-49b4-a726-04c85ea730f7", "name": "network-vif-plugged", "status": "completed", "tag": "4124fc99-9dcd-4dbc-b245-3aa44b05b837"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:32.894719 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7dc4cf00-8cac-45d0-a4b8-f52459852389 req-08280793-2ab1-430b-b30e-d8d7f26a5a41 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.895197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7dc4cf00-8cac-45d0-a4b8-f52459852389 req-08280793-2ab1-430b-b30e-d8d7f26a5a41 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.895856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-7dc4cf00-8cac-45d0-a4b8-f52459852389 req-08280793-2ab1-430b-b30e-d8d7f26a5a41 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.909621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-7dc4cf00-8cac-45d0-a4b8-f52459852389 req-08280793-2ab1-430b-b30e-d8d7f26a5a41 service nova] Creating event network-vif-plugged:4124fc99-9dcd-4dbc-b245-3aa44b05b837 for instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 on hv-cinder-85032 Aug 23 22:31:32.915586 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-7dc4cf00-8cac-45d0-a4b8-f52459852389 req-08280793-2ab1-430b-b30e-d8d7f26a5a41 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037912 Aug 23 22:31:32.916210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 531/859] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:32.922978 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-db7e331d-cc79-4dd7-8f59-e0d6ff5b8e31 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:32.924003 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-db7e331d-cc79-4dd7-8f59-e0d6ff5b8e31 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:32.933224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db7e331d-cc79-4dd7-8f59-e0d6ff5b8e31 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.933720 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db7e331d-cc79-4dd7-8f59-e0d6ff5b8e31 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.934180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db7e331d-cc79-4dd7-8f59-e0d6ff5b8e31 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:32.934859 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db7e331d-cc79-4dd7-8f59-e0d6ff5b8e31 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:32.935315 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db7e331d-cc79-4dd7-8f59-e0d6ff5b8e31 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:32.935735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-db7e331d-cc79-4dd7-8f59-e0d6ff5b8e31 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:33.117463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-db7e331d-cc79-4dd7-8f59-e0d6ff5b8e31 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:33.126376 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-db7e331d-cc79-4dd7-8f59-e0d6ff5b8e31 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1365 microversion: 2.1 time: 0.208007 Aug 23 22:31:33.127116 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 532/860] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:32 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:33.135066 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7c84abf5-2950-4014-a20f-307bb82834e1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:33.135858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7c84abf5-2950-4014-a20f-307bb82834e1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:33.144645 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c84abf5-2950-4014-a20f-307bb82834e1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:33.145616 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c84abf5-2950-4014-a20f-307bb82834e1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:33.146057 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c84abf5-2950-4014-a20f-307bb82834e1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:33.146856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c84abf5-2950-4014-a20f-307bb82834e1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:33.147617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c84abf5-2950-4014-a20f-307bb82834e1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:33.148352 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7c84abf5-2950-4014-a20f-307bb82834e1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:33.190319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7c84abf5-2950-4014-a20f-307bb82834e1 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments/e79d3b45-1e4b-4af7-b859-57b323d11a3b" status: 200 len: 194 microversion: 2.1 time: 0.061709 Aug 23 22:31:33.191235 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 533/861] 10.222.0.88 () {58 vars in 1413 bytes} [Tue Aug 23 22:31:33 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments/e79d3b45-1e4b-4af7-b859-57b323d11a3b => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:33.201996 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:33.202691 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:33.210675 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:33.211290 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:33.211911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:33.212915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:33.213618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:33.214112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:33.417579 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:33.429249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:33.431320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:33.432751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3396fbff-02e0-443c-bb65-471364996c20 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.234993 Aug 23 22:31:33.437122 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 534/862] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:33 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:33.833038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4f444614-8994-4adb-b29e-d24bfd1d29be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:33.833639 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4f444614-8994-4adb-b29e-d24bfd1d29be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:33.840374 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f444614-8994-4adb-b29e-d24bfd1d29be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:33.840891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f444614-8994-4adb-b29e-d24bfd1d29be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:33.841326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f444614-8994-4adb-b29e-d24bfd1d29be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:33.842028 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f444614-8994-4adb-b29e-d24bfd1d29be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:33.842606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f444614-8994-4adb-b29e-d24bfd1d29be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:33.842902 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f444614-8994-4adb-b29e-d24bfd1d29be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:33.987730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4f444614-8994-4adb-b29e-d24bfd1d29be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:33.996339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4f444614-8994-4adb-b29e-d24bfd1d29be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.167797 Aug 23 22:31:33.996928 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 535/863] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:33 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:34.157315 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1f26541a-581d-4223-835f-ff93ccb71878 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:34.158216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1f26541a-581d-4223-835f-ff93ccb71878 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:34.164496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1f26541a-581d-4223-835f-ff93ccb71878 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.164978 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1f26541a-581d-4223-835f-ff93ccb71878 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.165441 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1f26541a-581d-4223-835f-ff93ccb71878 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.166126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1f26541a-581d-4223-835f-ff93ccb71878 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.166568 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1f26541a-581d-4223-835f-ff93ccb71878 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.166983 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1f26541a-581d-4223-835f-ff93ccb71878 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.326739 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1f26541a-581d-4223-835f-ff93ccb71878 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:34.338498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1f26541a-581d-4223-835f-ff93ccb71878 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1365 microversion: 2.1 time: 0.185094 Aug 23 22:31:34.339095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 536/864] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:34 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:34.472555 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:34.474531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:34.482684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.483326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.483850 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.485333 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.486215 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.486783 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.660608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:34.679287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:34.682747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:34.685196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1bd54670-bba2-41c6-a024-ee1bb938e097 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.218033 Aug 23 22:31:34.686250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 537/865] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:34 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:34.800267 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-77cd7e48-9fee-4d21-b25d-86ee39bdf9b5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e75dc13c-ea75-4d55-b3af-af6e6de73b30"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:34.804559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-77cd7e48-9fee-4d21-b25d-86ee39bdf9b5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:34.811775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cd7e48-9fee-4d21-b25d-86ee39bdf9b5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.812378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cd7e48-9fee-4d21-b25d-86ee39bdf9b5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.813891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cd7e48-9fee-4d21-b25d-86ee39bdf9b5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:34.814794 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cd7e48-9fee-4d21-b25d-86ee39bdf9b5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:34.815361 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cd7e48-9fee-4d21-b25d-86ee39bdf9b5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:34.815865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cd7e48-9fee-4d21-b25d-86ee39bdf9b5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.229758 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-77cd7e48-9fee-4d21-b25d-86ee39bdf9b5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "POST /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437736 Aug 23 22:31:35.230768 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 538/866] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:31:34 2022] POST /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:35.240010 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b6313de5-b186-4f81-b32c-31401c1f35a3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:35.241031 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b6313de5-b186-4f81-b32c-31401c1f35a3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:35.254982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6313de5-b186-4f81-b32c-31401c1f35a3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.256020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6313de5-b186-4f81-b32c-31401c1f35a3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.257850 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6313de5-b186-4f81-b32c-31401c1f35a3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.259881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6313de5-b186-4f81-b32c-31401c1f35a3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.260935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6313de5-b186-4f81-b32c-31401c1f35a3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.263708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6313de5-b186-4f81-b32c-31401c1f35a3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.474115 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b6313de5-b186-4f81-b32c-31401c1f35a3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:35.485943 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b6313de5-b186-4f81-b32c-31401c1f35a3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.252238 Aug 23 22:31:35.487435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 539/867] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:35 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:35.508912 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-263a38b8-f00b-4856-aca5-b1e54ecd8964 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:35.509997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-263a38b8-f00b-4856-aca5-b1e54ecd8964 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:35.523552 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-263a38b8-f00b-4856-aca5-b1e54ecd8964 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.524609 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-263a38b8-f00b-4856-aca5-b1e54ecd8964 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.525315 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-263a38b8-f00b-4856-aca5-b1e54ecd8964 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.526837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-263a38b8-f00b-4856-aca5-b1e54ecd8964 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.527690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-263a38b8-f00b-4856-aca5-b1e54ecd8964 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.528485 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-263a38b8-f00b-4856-aca5-b1e54ecd8964 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.692625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-263a38b8-f00b-4856-aca5-b1e54ecd8964 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:35.702690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-263a38b8-f00b-4856-aca5-b1e54ecd8964 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1554 microversion: 2.1 time: 0.200199 Aug 23 22:31:35.703421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 540/868] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:35 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:35.727356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:35.727910 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:35.736566 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.737525 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.738321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.739585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.740762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.741624 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.935138 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:35.940149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:35.950896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:35.955272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:35.957800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2741dd63-fbd8-4fa3-8d88-ede06970db6a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.234630 Aug 23 22:31:35.975744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 541/869] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:35 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:35.975744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b9850e35-f7ca-4617-837c-5f24de8845da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:35.975744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b9850e35-f7ca-4617-837c-5f24de8845da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:35.993460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9850e35-f7ca-4617-837c-5f24de8845da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.994472 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9850e35-f7ca-4617-837c-5f24de8845da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.995285 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9850e35-f7ca-4617-837c-5f24de8845da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:35.996688 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9850e35-f7ca-4617-837c-5f24de8845da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:35.997755 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9850e35-f7ca-4617-837c-5f24de8845da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:35.998538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b9850e35-f7ca-4617-837c-5f24de8845da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:36.134406 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b9850e35-f7ca-4617-837c-5f24de8845da tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173227 Aug 23 22:31:36.135142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 542/870] 10.222.0.88 () {58 vars in 1275 bytes} [Tue Aug 23 22:31:35 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:36.522346 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8bfd5865-9d49-4a8d-9659-9a35edcec444 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:36.523852 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8bfd5865-9d49-4a8d-9659-9a35edcec444 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:36.533224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8bfd5865-9d49-4a8d-9659-9a35edcec444 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:36.534120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8bfd5865-9d49-4a8d-9659-9a35edcec444 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:36.534623 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8bfd5865-9d49-4a8d-9659-9a35edcec444 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:36.535662 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8bfd5865-9d49-4a8d-9659-9a35edcec444 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:36.536185 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8bfd5865-9d49-4a8d-9659-9a35edcec444 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:36.537434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8bfd5865-9d49-4a8d-9659-9a35edcec444 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:36.718568 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8bfd5865-9d49-4a8d-9659-9a35edcec444 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:36.727692 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8bfd5865-9d49-4a8d-9659-9a35edcec444 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.209511 Aug 23 22:31:36.728390 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 543/871] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:36 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:36.733672 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-fae0694c-952b-4588-b1e9-75aabf6d63af req-68f68c5a-798a-424b-a08b-f0b37ff28ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e", "name": "network-vif-plugged", "status": "completed", "tag": "21001569-2deb-472d-899a-71203a25df1a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:36.745589 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-fae0694c-952b-4588-b1e9-75aabf6d63af req-68f68c5a-798a-424b-a08b-f0b37ff28ba2 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:36.746432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-fae0694c-952b-4588-b1e9-75aabf6d63af req-68f68c5a-798a-424b-a08b-f0b37ff28ba2 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:36.747233 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-fae0694c-952b-4588-b1e9-75aabf6d63af req-68f68c5a-798a-424b-a08b-f0b37ff28ba2 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:36.761076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-fae0694c-952b-4588-b1e9-75aabf6d63af req-68f68c5a-798a-424b-a08b-f0b37ff28ba2 service nova] Creating event network-vif-plugged:21001569-2deb-472d-899a-71203a25df1a for instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e on hv-cinder-85032 Aug 23 22:31:36.766912 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-fae0694c-952b-4588-b1e9-75aabf6d63af req-68f68c5a-798a-424b-a08b-f0b37ff28ba2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036658 Aug 23 22:31:36.767787 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 544/872] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:37.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:37.004511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:37.017737 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:37.018747 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:37.019639 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:37.021153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:37.022120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:37.023072 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:37.303438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:37.314163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:37.317049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:37.318885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e32f076e-0573-4798-bb62-88b9b3d6194e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.324450 Aug 23 22:31:37.320171 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 545/873] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:36 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:37.451921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-fa2f0791-3a0b-4ff6-83eb-09611204506c req-2dffefc1-0cf3-443e-b19f-6e94fafdb470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f17a50-b5b6-49b4-a726-04c85ea730f7", "tag": "4124fc99-9dcd-4dbc-b245-3aa44b05b837"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:37.464265 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-fa2f0791-3a0b-4ff6-83eb-09611204506c req-2dffefc1-0cf3-443e-b19f-6e94fafdb470 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:37.465401 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-fa2f0791-3a0b-4ff6-83eb-09611204506c req-2dffefc1-0cf3-443e-b19f-6e94fafdb470 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:37.466038 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-fa2f0791-3a0b-4ff6-83eb-09611204506c req-2dffefc1-0cf3-443e-b19f-6e94fafdb470 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:37.480468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-fa2f0791-3a0b-4ff6-83eb-09611204506c req-2dffefc1-0cf3-443e-b19f-6e94fafdb470 service nova] Creating event network-changed:4124fc99-9dcd-4dbc-b245-3aa44b05b837 for instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 on hv-cinder-85032 Aug 23 22:31:37.489156 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-fa2f0791-3a0b-4ff6-83eb-09611204506c req-2dffefc1-0cf3-443e-b19f-6e94fafdb470 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040846 Aug 23 22:31:37.491036 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 546/874] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:37.760353 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d1a59008-de6b-4860-b76c-a6bd0d1aed83 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:37.762907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d1a59008-de6b-4860-b76c-a6bd0d1aed83 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:37.777791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1a59008-de6b-4860-b76c-a6bd0d1aed83 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:37.778733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1a59008-de6b-4860-b76c-a6bd0d1aed83 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:37.779775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1a59008-de6b-4860-b76c-a6bd0d1aed83 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:37.781235 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1a59008-de6b-4860-b76c-a6bd0d1aed83 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:37.782090 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1a59008-de6b-4860-b76c-a6bd0d1aed83 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:37.783161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d1a59008-de6b-4860-b76c-a6bd0d1aed83 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:38.080606 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d1a59008-de6b-4860-b76c-a6bd0d1aed83 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:38.095926 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d1a59008-de6b-4860-b76c-a6bd0d1aed83 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1265 microversion: 2.1 time: 0.347745 Aug 23 22:31:38.097927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 547/875] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:37 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:38.367050 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:38.368347 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:38.382278 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:38.383267 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:38.384161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:38.385593 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:38.386886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:38.387753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:38.631961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:38.652367 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:38.656419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:38.659145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-13de6cfa-0f85-4eb7-b29e-62694d096ed9 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.302677 Aug 23 22:31:38.659877 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 548/876] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:38 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:39.119499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f7813c9e-7677-4900-af91-e55b6c85eff7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:39.120342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f7813c9e-7677-4900-af91-e55b6c85eff7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:39.128023 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f7813c9e-7677-4900-af91-e55b6c85eff7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.129992 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f7813c9e-7677-4900-af91-e55b6c85eff7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.129992 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f7813c9e-7677-4900-af91-e55b6c85eff7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.129992 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f7813c9e-7677-4900-af91-e55b6c85eff7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.130850 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f7813c9e-7677-4900-af91-e55b6c85eff7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.131400 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f7813c9e-7677-4900-af91-e55b6c85eff7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.286154 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f7813c9e-7677-4900-af91-e55b6c85eff7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:39.294022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f7813c9e-7677-4900-af91-e55b6c85eff7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1452 microversion: 2.1 time: 0.178863 Aug 23 22:31:39.294656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 549/877] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:39 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:39.316016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-915ad2e8-ada7-46e8-bec0-140b3da92b16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:39.316623 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-915ad2e8-ada7-46e8-bec0-140b3da92b16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:39.322757 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-915ad2e8-ada7-46e8-bec0-140b3da92b16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.323243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-915ad2e8-ada7-46e8-bec0-140b3da92b16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.323680 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-915ad2e8-ada7-46e8-bec0-140b3da92b16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.324381 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-915ad2e8-ada7-46e8-bec0-140b3da92b16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.324854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-915ad2e8-ada7-46e8-bec0-140b3da92b16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.325388 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-915ad2e8-ada7-46e8-bec0-140b3da92b16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.471369 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-915ad2e8-ada7-46e8-bec0-140b3da92b16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:39.479899 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-915ad2e8-ada7-46e8-bec0-140b3da92b16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1452 microversion: 2.1 time: 0.167949 Aug 23 22:31:39.480486 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 550/878] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:39 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:39.691715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:39.692434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:39.722343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.723252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.724034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.725364 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:39.730988 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:39.731758 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:39.968626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:39.996211 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:39.999437 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:40.014929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7770e71e-6b89-4a25-a521-83ef445a8237 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.327835 Aug 23 22:31:40.015818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 551/879] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:39 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:41.063535 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:41.064900 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:41.072559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:41.073161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:41.073603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:41.074332 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:41.074790 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:41.075215 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:41.346958 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:41.367708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:41.371109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:41.373729 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2de4ad59-5bc0-4e2f-aa11-700056281845 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.315760 Aug 23 22:31:41.374728 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 552/880] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:41 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:42.130955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-1beacd65-9348-430b-8549-7906cb9ec438 req-7d9ab1bc-0abd-45cd-a177-a65cbec97da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e", "tag": "21001569-2deb-472d-899a-71203a25df1a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:42.148656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1beacd65-9348-430b-8549-7906cb9ec438 req-7d9ab1bc-0abd-45cd-a177-a65cbec97da7 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:42.148656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1beacd65-9348-430b-8549-7906cb9ec438 req-7d9ab1bc-0abd-45cd-a177-a65cbec97da7 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:42.149190 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1beacd65-9348-430b-8549-7906cb9ec438 req-7d9ab1bc-0abd-45cd-a177-a65cbec97da7 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:42.164469 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-1beacd65-9348-430b-8549-7906cb9ec438 req-7d9ab1bc-0abd-45cd-a177-a65cbec97da7 service nova] Creating event network-changed:21001569-2deb-472d-899a-71203a25df1a for instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e on hv-cinder-85032 Aug 23 22:31:42.170909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-1beacd65-9348-430b-8549-7906cb9ec438 req-7d9ab1bc-0abd-45cd-a177-a65cbec97da7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044124 Aug 23 22:31:42.172030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 553/881] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:42.400306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:42.401683 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:42.405711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=100 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:42.414217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:42.414885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:42.415618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:42.416461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:42.417404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:42.417998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:42.753609 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:42.766631 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:42.768978 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:42.771155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c0c3756f-4236-4658-91c8-7168ec453c53 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.376112 Aug 23 22:31:42.772162 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 554/882] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:42 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:43.131260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-90623d09-9007-4e3a-8de2-4d25906ccacb tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:43.133677 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-90623d09-9007-4e3a-8de2-4d25906ccacb tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:43.142742 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-90623d09-9007-4e3a-8de2-4d25906ccacb tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.143574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-90623d09-9007-4e3a-8de2-4d25906ccacb tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.144024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-90623d09-9007-4e3a-8de2-4d25906ccacb tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.144808 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-90623d09-9007-4e3a-8de2-4d25906ccacb tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.147979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-90623d09-9007-4e3a-8de2-4d25906ccacb tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.148515 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-90623d09-9007-4e3a-8de2-4d25906ccacb tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.196718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-90623d09-9007-4e3a-8de2-4d25906ccacb tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.071131 Aug 23 22:31:43.197553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 555/883] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:31:43 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:43.358231 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6b370e00-79b8-494e-9280-891a73c408ca tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:43.360157 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6b370e00-79b8-494e-9280-891a73c408ca tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:43.377554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6b370e00-79b8-494e-9280-891a73c408ca tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.378481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6b370e00-79b8-494e-9280-891a73c408ca tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.379338 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6b370e00-79b8-494e-9280-891a73c408ca tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.380723 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6b370e00-79b8-494e-9280-891a73c408ca tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.381751 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6b370e00-79b8-494e-9280-891a73c408ca tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.383526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6b370e00-79b8-494e-9280-891a73c408ca tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.446311 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6b370e00-79b8-494e-9280-891a73c408ca tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments/e79d3b45-1e4b-4af7-b859-57b323d11a3b" status: 200 len: 194 microversion: 2.1 time: 0.092713 Aug 23 22:31:43.447430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 556/884] 10.222.0.88 () {58 vars in 1413 bytes} [Tue Aug 23 22:31:43 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments/e79d3b45-1e4b-4af7-b859-57b323d11a3b => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:43.466417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-61a3a175-752b-40c9-83bf-769f2278504e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:43.467305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-61a3a175-752b-40c9-83bf-769f2278504e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:43.479717 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61a3a175-752b-40c9-83bf-769f2278504e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.480616 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61a3a175-752b-40c9-83bf-769f2278504e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.481492 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61a3a175-752b-40c9-83bf-769f2278504e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.483217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61a3a175-752b-40c9-83bf-769f2278504e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.484320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61a3a175-752b-40c9-83bf-769f2278504e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.485378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-61a3a175-752b-40c9-83bf-769f2278504e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.611718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-61a3a175-752b-40c9-83bf-769f2278504e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lazy-loading 'services' on Instance uuid eb06a53f-d4f0-465e-9c75-8d72e44c0640 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:31:43.731629 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-61a3a175-752b-40c9-83bf-769f2278504e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "DELETE /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments/e79d3b45-1e4b-4af7-b859-57b323d11a3b" status: 202 len: 0 microversion: 2.1 time: 0.272064 Aug 23 22:31:43.732730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 557/885] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:31:43 2022] DELETE /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments/e79d3b45-1e4b-4af7-b859-57b323d11a3b => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:31:43.809395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:43.810688 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:43.827855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.828909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.829942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:43.830445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:43.831079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:43.831947 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:44.084278 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:44.100566 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:44.106715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:44.108130 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-62ec125b-aff3-4ae5-9756-7c7fa5987563 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.313729 Aug 23 22:31:44.121498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 558/886] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:43 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:45.138631 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:45.139843 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:45.157683 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:45.158832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:45.159624 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:45.160912 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:45.161791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:45.162508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:45.405965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:45.422850 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:45.426390 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:45.428803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-dea982a2-1b57-40f7-9fcc-8ba9f728f204 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.297906 Aug 23 22:31:45.429959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 559/887] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:45 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:46.067984 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-dbf5aac0-2468-49f8-9504-f461550b75f7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:46.068971 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-dbf5aac0-2468-49f8-9504-f461550b75f7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:46.080869 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbf5aac0-2468-49f8-9504-f461550b75f7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:46.081584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbf5aac0-2468-49f8-9504-f461550b75f7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:46.082517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbf5aac0-2468-49f8-9504-f461550b75f7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:46.084244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbf5aac0-2468-49f8-9504-f461550b75f7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:46.084981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbf5aac0-2468-49f8-9504-f461550b75f7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:46.085798 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbf5aac0-2468-49f8-9504-f461550b75f7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:46.093514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:46.137008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-dbf5aac0-2468-49f8-9504-f461550b75f7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments/e75dc13c-ea75-4d55-b3af-af6e6de73b30" status: 200 len: 194 microversion: 2.1 time: 0.077610 Aug 23 22:31:46.138153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 560/888] 10.222.0.88 () {58 vars in 1413 bytes} [Tue Aug 23 22:31:46 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments/e75dc13c-ea75-4d55-b3af-af6e6de73b30 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:46.151530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c7c30cd8-11ad-4a05-a0ef-0116d2c26b57 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:46.152600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c7c30cd8-11ad-4a05-a0ef-0116d2c26b57 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:46.160298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7c30cd8-11ad-4a05-a0ef-0116d2c26b57 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:46.160832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7c30cd8-11ad-4a05-a0ef-0116d2c26b57 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:46.161353 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7c30cd8-11ad-4a05-a0ef-0116d2c26b57 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:46.162099 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7c30cd8-11ad-4a05-a0ef-0116d2c26b57 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:46.162827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7c30cd8-11ad-4a05-a0ef-0116d2c26b57 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:46.163338 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c7c30cd8-11ad-4a05-a0ef-0116d2c26b57 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:46.306291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-c7c30cd8-11ad-4a05-a0ef-0116d2c26b57 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lazy-loading 'services' on Instance uuid eb06a53f-d4f0-465e-9c75-8d72e44c0640 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:31:46.427864 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c7c30cd8-11ad-4a05-a0ef-0116d2c26b57 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "DELETE /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments/e75dc13c-ea75-4d55-b3af-af6e6de73b30" status: 202 len: 0 microversion: 2.1 time: 0.281041 Aug 23 22:31:46.428876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 561/889] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:31:46 2022] DELETE /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments/e75dc13c-ea75-4d55-b3af-af6e6de73b30 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:31:46.469009 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:46.470303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:46.486883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:46.489043 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:46.490152 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:46.491146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:46.491548 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:46.491993 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:46.718122 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:46.727759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:46.730722 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:46.732827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-46cffe61-28ba-4942-a93d-413462dd577b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1744 microversion: 2.20 time: 0.268466 Aug 23 22:31:46.734696 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 562/890] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:46 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1744 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:47.714842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3bba6434-96d0-460d-8dd9-c6305053d448 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:47.718897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3bba6434-96d0-460d-8dd9-c6305053d448 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:47.726767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bba6434-96d0-460d-8dd9-c6305053d448 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:47.727250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bba6434-96d0-460d-8dd9-c6305053d448 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:47.727875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bba6434-96d0-460d-8dd9-c6305053d448 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:47.728594 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bba6434-96d0-460d-8dd9-c6305053d448 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:47.729587 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bba6434-96d0-460d-8dd9-c6305053d448 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:47.730010 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3bba6434-96d0-460d-8dd9-c6305053d448 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:47.768137 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3bba6434-96d0-460d-8dd9-c6305053d448 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060331 Aug 23 22:31:47.769273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 563/891] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:31:47 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 22:31:47.783024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:47.783798 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:47.795122 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:47.796079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:47.796840 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:47.802901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:47.803540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:47.804277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:47.979255 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:47.989875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:47.991658 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:47.993083 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9bb253fd-df41-4ea6-a77e-06ea80f407da tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1744 microversion: 2.20 time: 0.218640 Aug 23 22:31:47.993670 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 564/892] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:47 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:47.999549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6c07ea82-fc97-45dd-9519-79920d99c931 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:48.003175 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6c07ea82-fc97-45dd-9519-79920d99c931 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:48.010738 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c07ea82-fc97-45dd-9519-79920d99c931 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.011230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c07ea82-fc97-45dd-9519-79920d99c931 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.011665 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c07ea82-fc97-45dd-9519-79920d99c931 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.012381 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c07ea82-fc97-45dd-9519-79920d99c931 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.013598 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c07ea82-fc97-45dd-9519-79920d99c931 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.014200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c07ea82-fc97-45dd-9519-79920d99c931 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.051320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6c07ea82-fc97-45dd-9519-79920d99c931 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056406 Aug 23 22:31:48.052249 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 565/893] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:31:47 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:31:48.139254 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5d4b6e1a-9f57-402e-b27d-d75fb2efa76a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:48.139823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5d4b6e1a-9f57-402e-b27d-d75fb2efa76a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:48.148020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d4b6e1a-9f57-402e-b27d-d75fb2efa76a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.148562 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d4b6e1a-9f57-402e-b27d-d75fb2efa76a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.149079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d4b6e1a-9f57-402e-b27d-d75fb2efa76a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.149934 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d4b6e1a-9f57-402e-b27d-d75fb2efa76a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.150440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d4b6e1a-9f57-402e-b27d-d75fb2efa76a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.150919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5d4b6e1a-9f57-402e-b27d-d75fb2efa76a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.180287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5d4b6e1a-9f57-402e-b27d-d75fb2efa76a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:31:48.282433 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5d4b6e1a-9f57-402e-b27d-d75fb2efa76a tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "DELETE /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 204 len: 0 microversion: 2.1 time: 0.146251 Aug 23 22:31:48.283964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 566/894] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:31:48 2022] DELETE /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:31:48.299983 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0b600ae2-09ea-4027-aa4d-918092c5f76f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:48.300951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0b600ae2-09ea-4027-aa4d-918092c5f76f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:48.310282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b600ae2-09ea-4027-aa4d-918092c5f76f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.310786 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b600ae2-09ea-4027-aa4d-918092c5f76f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.311226 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b600ae2-09ea-4027-aa4d-918092c5f76f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.311960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b600ae2-09ea-4027-aa4d-918092c5f76f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:48.313039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b600ae2-09ea-4027-aa4d-918092c5f76f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:48.313867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b600ae2-09ea-4027-aa4d-918092c5f76f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:48.552276 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0b600ae2-09ea-4027-aa4d-918092c5f76f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:48.562167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0b600ae2-09ea-4027-aa4d-918092c5f76f tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1671 microversion: 2.1 time: 0.270689 Aug 23 22:31:48.563225 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 567/895] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:48 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1671 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:49.029648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:49.030326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:49.038468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:49.039286 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:49.039742 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:49.040740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:49.041239 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:49.041894 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:49.230920 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:49.241265 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:49.242899 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:49.244172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6e054999-e13a-49ac-82be-1203b7e062cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1744 microversion: 2.20 time: 0.218882 Aug 23 22:31:49.244771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 568/896] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:49 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:49.598420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-889df4c1-3b57-4932-b6f8-85870082f39e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:49.599028 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-889df4c1-3b57-4932-b6f8-85870082f39e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:49.612609 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-889df4c1-3b57-4932-b6f8-85870082f39e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:49.613216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-889df4c1-3b57-4932-b6f8-85870082f39e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:49.613658 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-889df4c1-3b57-4932-b6f8-85870082f39e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:49.614385 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-889df4c1-3b57-4932-b6f8-85870082f39e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:49.614837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-889df4c1-3b57-4932-b6f8-85870082f39e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:49.615314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-889df4c1-3b57-4932-b6f8-85870082f39e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:49.784860 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-889df4c1-3b57-4932-b6f8-85870082f39e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:49.796949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-889df4c1-3b57-4932-b6f8-85870082f39e tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1671 microversion: 2.1 time: 0.203187 Aug 23 22:31:49.798727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 569/897] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:49 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1671 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:50.275553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:50.276762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:50.289340 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.290159 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.290819 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:50.291987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.292657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.293513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:50.526402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:50.555170 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:50.558420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:50.560782 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-731ea085-0e73-4320-8e54-9daab2c10e91 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1744 microversion: 2.20 time: 0.293043 Aug 23 22:31:50.564583 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 570/898] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:50 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1744 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:50.808906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-b2e220e1-4ec7-4565-892b-0ef6c73edb33 req-a3aa26ba-a5f0-4e36-9611-db59530adcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84b4a2f-7ca4-4281-84ff-69efdc3897a2", "name": "network-vif-plugged", "status": "completed", "tag": "2145ae08-8d67-45d5-bc60-d74ff38d6e5a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:50.840564 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-b2e220e1-4ec7-4565-892b-0ef6c73edb33 req-a3aa26ba-a5f0-4e36-9611-db59530adcc4 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.841340 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-b2e220e1-4ec7-4565-892b-0ef6c73edb33 req-a3aa26ba-a5f0-4e36-9611-db59530adcc4 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.842189 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-b2e220e1-4ec7-4565-892b-0ef6c73edb33 req-a3aa26ba-a5f0-4e36-9611-db59530adcc4 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:50.869403 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-b2e220e1-4ec7-4565-892b-0ef6c73edb33 req-a3aa26ba-a5f0-4e36-9611-db59530adcc4 service nova] Creating event network-vif-plugged:2145ae08-8d67-45d5-bc60-d74ff38d6e5a for instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 on hv-cinder-85032 Aug 23 22:31:50.878518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-b2e220e1-4ec7-4565-892b-0ef6c73edb33 req-a3aa26ba-a5f0-4e36-9611-db59530adcc4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077053 Aug 23 22:31:50.880082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 571/899] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:31:50.886948 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-64311c2e-43e1-4db2-aea2-5fb21dcb21e6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:50.887972 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-64311c2e-43e1-4db2-aea2-5fb21dcb21e6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:50.899084 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-64311c2e-43e1-4db2-aea2-5fb21dcb21e6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.899975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-64311c2e-43e1-4db2-aea2-5fb21dcb21e6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.900581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-64311c2e-43e1-4db2-aea2-5fb21dcb21e6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:50.901531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-64311c2e-43e1-4db2-aea2-5fb21dcb21e6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:50.902197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-64311c2e-43e1-4db2-aea2-5fb21dcb21e6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:50.902778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-64311c2e-43e1-4db2-aea2-5fb21dcb21e6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:51.283291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-64311c2e-43e1-4db2-aea2-5fb21dcb21e6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:51.304555 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-64311c2e-43e1-4db2-aea2-5fb21dcb21e6 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1671 microversion: 2.1 time: 0.422263 Aug 23 22:31:51.306201 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 572/900] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:50 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1671 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:31:51.599762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:51.599993 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:51.615526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:51.616496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:51.617136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:51.618766 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:51.620686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:51.626984 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:52.096620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:52.113922 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:52.123822 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:52.130840 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8934e537-b5fe-4103-9fe7-8ca497c60b8a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1739 microversion: 2.20 time: 0.534504 Aug 23 22:31:52.161432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 573/901] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:51 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1739 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:52.340494 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-852274a1-12a2-4317-b70c-524c43fceee4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:52.341552 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-852274a1-12a2-4317-b70c-524c43fceee4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:52.365580 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-852274a1-12a2-4317-b70c-524c43fceee4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:52.366395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-852274a1-12a2-4317-b70c-524c43fceee4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:52.366990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-852274a1-12a2-4317-b70c-524c43fceee4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:52.367878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-852274a1-12a2-4317-b70c-524c43fceee4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:52.368519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-852274a1-12a2-4317-b70c-524c43fceee4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:52.369121 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-852274a1-12a2-4317-b70c-524c43fceee4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:52.468761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-852274a1-12a2-4317-b70c-524c43fceee4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e720fd25d54b4dc6b3387ea762d7e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a297ef598b76404b86e9350e120b86c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:52.488583 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-852274a1-12a2-4317-b70c-524c43fceee4 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 200 len: 1604 microversion: 2.1 time: 0.159366 Aug 23 22:31:52.489582 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 574/902] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:52 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 1604 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:31:52.610876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-aae6ea54-4d47-481f-9c5a-4873c7c24703 req-ed05b6a0-ceef-4ea3-9c6b-8851536a4d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb06a53f-d4f0-465e-9c75-8d72e44c0640", "name": "network-vif-deleted", "tag": "edad9bc4-ba17-4879-b9ef-138943b74c95"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:31:52.630932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-aae6ea54-4d47-481f-9c5a-4873c7c24703 req-ed05b6a0-ceef-4ea3-9c6b-8851536a4d97 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:52.631446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-aae6ea54-4d47-481f-9c5a-4873c7c24703 req-ed05b6a0-ceef-4ea3-9c6b-8851536a4d97 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:52.632009 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-aae6ea54-4d47-481f-9c5a-4873c7c24703 req-ed05b6a0-ceef-4ea3-9c6b-8851536a4d97 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:52.635130 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:52.660281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-aae6ea54-4d47-481f-9c5a-4873c7c24703 req-ed05b6a0-ceef-4ea3-9c6b-8851536a4d97 service nova] Creating event network-vif-deleted:edad9bc4-ba17-4879-b9ef-138943b74c95 for instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 on hv-cinder-85032 Aug 23 22:31:52.672834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-aae6ea54-4d47-481f-9c5a-4873c7c24703 req-ed05b6a0-ceef-4ea3-9c6b-8851536a4d97 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066871 Aug 23 22:31:52.677495 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 575/903] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:31:53.182113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:53.184604 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:53.196912 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:53.198084 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:53.199070 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:53.200070 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:53.200766 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:53.201447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:53.517218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:53.530549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:53.534298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:53.536416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e420914f-1492-4e6d-954d-5f1057f0ca41 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1739 microversion: 2.20 time: 0.367297 Aug 23 22:31:53.543720 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 576/904] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:53 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:53.549858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:53.550803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:53.563042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:53.568903 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:53.568903 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:53.569917 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:53.570685 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:53.572345 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:53.592508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] HTTP exception thrown: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Request method failure captured: Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 HTTP/1.1 Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOpFgR8mEb7G4nPjwgWgf9Ai_EcubfiXK0fp7E0AxsycfW_wrI5dCjhPBwlTsfK5sjiwhwv3KE6XQN3BeQcrn4Shwud96iEsoMi-G_DBSmMnNJYD90nR0AMhzKQfkDUisFCkRvrpEpwaB0X4ddR3kjPWoPJWveaMf6xzD-M_d8iesw Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:31:53.595610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a297ef598b76404b86e9350e120b86c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}] Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: e720fd25d54b4dc6b3387ea762d7e4ae Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:53.597855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'eb06a53f-d4f0-465e-9c75-8d72e44c0640'} Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:53.598981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:53.600678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:53.604577 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Returning 404 to user: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:53.605726 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6c065181-5d81-409b-af16-8e5f7004eee5 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 404 len: 111 microversion: 2.1 time: 0.066191 Aug 23 22:31:53.606444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 577/905] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:53 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:31:53.617010 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9e4ff55c-0cb0-45a0-a6a1-e6a8a744b294 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '.version_select at 0x7f901fe119d0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:53.645108 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9e4ff55c-0cb0-45a0-a6a1-e6a8a744b294 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933694992" status: 202 len: 0 microversion: 2.1 time: 0.033332 Aug 23 22:31:53.650501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 578/906] 10.222.0.88 () {58 vars in 1218 bytes} [Tue Aug 23 22:31:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933694992 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:31:54.567141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:54.567878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:54.586641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:54.587568 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:54.588261 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:54.589180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:54.589793 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:54.590379 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:54.780130 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:54.790426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:54.792163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:54.793649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8adbab7a-a805-4778-8153-2e810081545c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1739 microversion: 2.20 time: 0.235289 Aug 23 22:31:54.794386 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 579/907] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:54 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:55.834422 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:55.836125 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:55.849496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:55.850311 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:55.850803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:55.851621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:55.852250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:55.852856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:56.099067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:56.108684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:56.110489 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:56.112169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7aa4bebf-e03f-41cb-8bc2-ec7e892954c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1739 microversion: 2.20 time: 0.282352 Aug 23 22:31:56.112744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 580/908] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:55 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:57.007144 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:57.007818 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:57.014962 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.016863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.017458 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.018189 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.018831 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.019435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.037487 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] HTTP exception thrown: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Request method failure captured: Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 HTTP/1.1 Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOpFgR8mEb7G4nPjwgWgf9Ai_EcubfiXK0fp7E0AxsycfW_wrI5dCjhPBwlTsfK5sjiwhwv3KE6XQN3BeQcrn4Shwud96iEsoMi-G_DBSmMnNJYD90nR0AMhzKQfkDUisFCkRvrpEpwaB0X4ddR3kjPWoPJWveaMf6xzD-M_d8iesw Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:31:57.039377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a297ef598b76404b86e9350e120b86c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}] Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: e720fd25d54b4dc6b3387ea762d7e4ae Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:57.040752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'eb06a53f-d4f0-465e-9c75-8d72e44c0640'} Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:57.041569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:57.043002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:57.045445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Returning 404 to user: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:57.046228 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8263588c-1fa7-4374-84d4-44d5458e73e7 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "DELETE /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 404 len: 111 microversion: 2.1 time: 0.043052 Aug 23 22:31:57.048000 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 581/909] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:31:57 2022] DELETE /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:31:57.056896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:57.057456 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: eb06a53f-d4f0-465e-9c75-8d72e44c0640] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:57.066961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.067764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.068382 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.069307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.069929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.070540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.089147 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] HTTP exception thrown: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Request method failure captured: Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 HTTP/1.1 Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOpFgR8mEb7G4nPjwgWgf9Ai_EcubfiXK0fp7E0AxsycfW_wrI5dCjhPBwlTsfK5sjiwhwv3KE6XQN3BeQcrn4Shwud96iEsoMi-G_DBSmMnNJYD90nR0AMhzKQfkDUisFCkRvrpEpwaB0X4ddR3kjPWoPJWveaMf6xzD-M_d8iesw Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:31:57.091045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a297ef598b76404b86e9350e120b86c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}] Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: e720fd25d54b4dc6b3387ea762d7e4ae Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:57.092626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'eb06a53f-d4f0-465e-9c75-8d72e44c0640'} Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:57.093626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. Aug 23 22:31:57.095674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:57.096761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Returning 404 to user: Instance eb06a53f-d4f0-465e-9c75-8d72e44c0640 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:57.096761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b3251669-14ee-4512-8675-e37e93a33084 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640" status: 404 len: 111 microversion: 2.1 time: 0.039979 Aug 23 22:31:57.096761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 582/910] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:57 2022] GET /compute/v2.1/servers/eb06a53f-d4f0-465e-9c75-8d72e44c0640 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:31:57.153852 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:57.154598 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:57.166619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.166619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.166619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.166619 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:57.167069 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:57.167069 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:57.399760 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:57.412872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:57.414575 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:57.416113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9483dce3-44a4-41c7-8f5b-268f0ca199d2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1739 microversion: 2.20 time: 0.268068 Aug 23 22:31:57.417300 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 583/911] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:57 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:31:58.292666 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:58.293531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:58.301156 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:58.301997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:58.302444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:58.303222 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:58.303643 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:58.304063 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:58.320413 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] HTTP exception thrown: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Request method failure captured: Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 HTTP/1.1 Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOpFgR8mEb7G4nPjwgWgf9Ai_EcubfiXK0fp7E0AxsycfW_wrI5dCjhPBwlTsfK5sjiwhwv3KE6XQN3BeQcrn4Shwud96iEsoMi-G_DBSmMnNJYD90nR0AMhzKQfkDUisFCkRvrpEpwaB0X4ddR3kjPWoPJWveaMf6xzD-M_d8iesw Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:31:58.322059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a297ef598b76404b86e9350e120b86c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}] Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: e720fd25d54b4dc6b3387ea762d7e4ae Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:31:58.324563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'fd812373-cfc2-4d5e-8230-2e0a72153994'} Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:58.325640 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:31:58.327307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:58.329803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Returning 404 to user: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:58.329803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-69894a5b-f0fc-4f01-a1d8-8ff5eda3cd06 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 404 len: 111 microversion: 2.1 time: 0.034957 Aug 23 22:31:58.329803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 584/912] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:31:58 2022] DELETE /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:31:58.333514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:58.334150 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] [instance: fd812373-cfc2-4d5e-8230-2e0a72153994] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:58.340989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:58.341692 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:58.341962 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:58.342706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:58.343160 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:58.343666 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:58.360921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] HTTP exception thrown: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Request method failure captured: Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 HTTP/1.1 Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOpFgR8mEb7G4nPjwgWgf9Ai_EcubfiXK0fp7E0AxsycfW_wrI5dCjhPBwlTsfK5sjiwhwv3KE6XQN3BeQcrn4Shwud96iEsoMi-G_DBSmMnNJYD90nR0AMhzKQfkDUisFCkRvrpEpwaB0X4ddR3kjPWoPJWveaMf6xzD-M_d8iesw Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:31:58.362633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a297ef598b76404b86e9350e120b86c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a297ef598b76404b86e9350e120b86c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a297ef598b76404b86e9350e120b86c9"}]}] Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: a297ef598b76404b86e9350e120b86c9 Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050372333 Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: e720fd25d54b4dc6b3387ea762d7e4ae Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeTestJSON-1050372333-project Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:31:58.364024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'fd812373-cfc2-4d5e-8230-2e0a72153994'} Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:31:58.364889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. Aug 23 22:31:58.366119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:31:58.367292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] Returning 404 to user: Instance fd812373-cfc2-4d5e-8230-2e0a72153994 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:31:58.367292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2fdc389f-d4f8-45d5-b6cf-418ccdcefdf8 tempest-AttachVolumeTestJSON-1050372333 tempest-AttachVolumeTestJSON-1050372333-project] 10.222.0.88 "GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994" status: 404 len: 111 microversion: 2.1 time: 0.034770 Aug 23 22:31:58.367292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 585/913] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:31:58 2022] GET /compute/v2.1/servers/fd812373-cfc2-4d5e-8230-2e0a72153994 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:31:58.457999 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:58.460410 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:58.471112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:58.471786 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:58.472421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:58.473282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:58.473749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:58.474415 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:58.666067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:58.685523 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:58.687782 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:58.690142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0885239b-7add-4369-b8b4-3f9d08f9f04e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1739 microversion: 2.20 time: 0.245723 Aug 23 22:31:58.691718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 586/914] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:58 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:31:59.723140 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:31:59.724608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:31:59.732537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:59.733498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:59.734733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:59.735828 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:31:59.736178 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:31:59.736596 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:31:59.948975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:59.960030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:59.963945 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:31:59.963945 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-eda599d9-a465-42a7-85cb-fb033d2237c2 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1739 microversion: 2.20 time: 0.246892 Aug 23 22:31:59.971081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 587/915] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:31:59 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:00.987471 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:00.988509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:01.005011 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:01.005543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:01.005973 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:01.007871 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:01.008532 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:01.009312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:01.247098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:01.261195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:01.262907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:01.264334 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4d8f3da5-0d14-4bd6-82d4-24ea637f3d75 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1739 microversion: 2.20 time: 0.281732 Aug 23 22:32:01.281337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 588/916] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:00 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:02.288786 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:02.289939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:02.300545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:02.301721 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:02.303932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:02.309045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:02.310595 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:02.311429 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:02.805376 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:02.818025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:02.824156 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:02.825927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2a3542d2-1c25-41f7-92e1-68c43f1fe22a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1739 microversion: 2.20 time: 0.541116 Aug 23 22:32:02.826716 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 589/917] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:02 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1739 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:03.858151 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:03.859901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:03.870771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:03.872037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:03.873862 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:03.876367 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:03.877102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:03.877878 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:04.576080 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:04.595547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:04.599005 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:04.601561 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-da1424a9-d27b-4a15-b511-faeca777cc06 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1721 microversion: 2.20 time: 0.751841 Aug 23 22:32:04.602765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 590/918] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:03 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1721 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:05.629122 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:05.630323 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:05.637475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:05.637956 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:05.638380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:05.639093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:05.639770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:05.640932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:05.830017 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:05.841783 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:05.844755 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:05.846182 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-12224f77-e883-4b9f-85e3-a9499d4197cc tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1721 microversion: 2.20 time: 0.221324 Aug 23 22:32:05.846976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 591/919] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:05 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:06.869705 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:06.870368 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:06.877035 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:06.877581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:06.878021 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:06.878743 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:06.879195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:06.879618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:07.057712 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:07.063569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:07.065711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:07.067103 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6ef80b5b-e3a3-4525-b6a2-7b44d3c52e8c tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1721 microversion: 2.20 time: 0.201267 Aug 23 22:32:07.067761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 592/920] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:06 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:07.073193 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ae51c94a-0616-468f-8692-84da7c13b0d2 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f902c25eb80>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:07.149320 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ae51c94a-0616-468f-8692-84da7c13b0d2 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/1557a2ac-21a1-46c4-bc22-84090282dd15" status: 200 len: 351 microversion: 2.1 time: 0.079836 Aug 23 22:32:07.149995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 593/921] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:32:07 2022] GET /compute/v2.1/os-volumes/1557a2ac-21a1-46c4-bc22-84090282dd15 => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:32:08.094810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:08.095482 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:08.102485 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.102980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.103414 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.104140 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.104587 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.105008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.240225 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:08.248761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:08.250750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:08.251955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-65ee10c9-c752-486b-b018-f5c9cee72a7a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1664 microversion: 2.20 time: 0.162271 Aug 23 22:32:08.252535 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 594/922] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:08 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:08.276113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-67257484-eb31-4047-a41b-3813ace0864a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52b17b1f-3650-4ec9-b181-4f03d555b98d"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:08.278749 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-67257484-eb31-4047-a41b-3813ace0864a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:08.286044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67257484-eb31-4047-a41b-3813ace0864a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.286531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67257484-eb31-4047-a41b-3813ace0864a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.286970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67257484-eb31-4047-a41b-3813ace0864a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.287680 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67257484-eb31-4047-a41b-3813ace0864a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.288141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67257484-eb31-4047-a41b-3813ace0864a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.288558 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67257484-eb31-4047-a41b-3813ace0864a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.524753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:08.641734 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-67257484-eb31-4047-a41b-3813ace0864a tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "POST /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.369689 Aug 23 22:32:08.642383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 595/923] 10.222.0.88 () {62 vars in 1364 bytes} [Tue Aug 23 22:32:08 2022] POST /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/os-volume_attachments => generated 188 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 22:32:08.647098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-42fca5fd-d6fd-4aee-8e3e-1644a4eb45ab req-fbf3a572-e697-48d6-8674-f28509311024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84b4a2f-7ca4-4281-84ff-69efdc3897a2", "name": "network-vif-unplugged", "status": "completed", "tag": "2145ae08-8d67-45d5-bc60-d74ff38d6e5a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:08.657068 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-42fca5fd-d6fd-4aee-8e3e-1644a4eb45ab req-fbf3a572-e697-48d6-8674-f28509311024 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.657534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-42fca5fd-d6fd-4aee-8e3e-1644a4eb45ab req-fbf3a572-e697-48d6-8674-f28509311024 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.657965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-42fca5fd-d6fd-4aee-8e3e-1644a4eb45ab req-fbf3a572-e697-48d6-8674-f28509311024 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.670303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.compute.server_external_events [req-42fca5fd-d6fd-4aee-8e3e-1644a4eb45ab req-fbf3a572-e697-48d6-8674-f28509311024 service nova] Unable to find a host for instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2. Dropping event network-vif-unplugged {{(pid=120856) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 22:32:08.671821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-42fca5fd-d6fd-4aee-8e3e-1644a4eb45ab req-fbf3a572-e697-48d6-8674-f28509311024 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027830 Aug 23 22:32:08.672417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 596/924] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 22:32:08.680825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-28ab24e8-06f6-41b0-96d8-750c149a1a42 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f902c129430>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:08.740848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-28ab24e8-06f6-41b0-96d8-750c149a1a42 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/e4a6365d-6c10-452a-a138-a44f4213c8d6" status: 200 len: 350 microversion: 2.1 time: 0.063713 Aug 23 22:32:08.741512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 597/925] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:32:08 2022] GET /compute/v2.1/os-volumes/e4a6365d-6c10-452a-a138-a44f4213c8d6 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:32:08.784256 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b8cd3d53-7296-4aa0-bb95-174d501afe59 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:08.784758 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b8cd3d53-7296-4aa0-bb95-174d501afe59 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:08.791264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8cd3d53-7296-4aa0-bb95-174d501afe59 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.791989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8cd3d53-7296-4aa0-bb95-174d501afe59 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.792627 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8cd3d53-7296-4aa0-bb95-174d501afe59 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:08.793396 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8cd3d53-7296-4aa0-bb95-174d501afe59 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:08.793856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8cd3d53-7296-4aa0-bb95-174d501afe59 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:08.794290 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b8cd3d53-7296-4aa0-bb95-174d501afe59 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:09.193217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b8cd3d53-7296-4aa0-bb95-174d501afe59 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/os-volume_attachments/52b17b1f-3650-4ec9-b181-4f03d555b98d" status: 202 len: 0 microversion: 2.20 time: 0.414028 Aug 23 22:32:09.194724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 598/926] 10.222.0.88 () {60 vars in 1457 bytes} [Tue Aug 23 22:32:08 2022] DELETE /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/os-volume_attachments/52b17b1f-3650-4ec9-b181-4f03d555b98d => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:32:09.294317 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-403ee692-5c93-4f9a-8c5a-52d4d16ca355 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:09.295009 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-403ee692-5c93-4f9a-8c5a-52d4d16ca355 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:09.305768 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-403ee692-5c93-4f9a-8c5a-52d4d16ca355 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:09.306344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-403ee692-5c93-4f9a-8c5a-52d4d16ca355 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:09.306862 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-403ee692-5c93-4f9a-8c5a-52d4d16ca355 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:09.308226 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-403ee692-5c93-4f9a-8c5a-52d4d16ca355 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:09.308847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-403ee692-5c93-4f9a-8c5a-52d4d16ca355 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:09.309215 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-403ee692-5c93-4f9a-8c5a-52d4d16ca355 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:09.353089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-403ee692-5c93-4f9a-8c5a-52d4d16ca355 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120856) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 22:32:09.368690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:09.454928 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-403ee692-5c93-4f9a-8c5a-52d4d16ca355 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "POST /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/action" status: 202 len: 0 microversion: 2.20 time: 0.165948 Aug 23 22:32:09.456099 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 599/927] 10.222.0.88 () {62 vars in 1319 bytes} [Tue Aug 23 22:32:09 2022] POST /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:32:09.470458 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:09.471767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:09.486438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:09.487309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:09.488103 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:09.489592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:09.490322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:09.491057 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:09.725789 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:09.735729 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:09.737287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:09.738482 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e1e03fe2-080b-4531-8ff9-e4dc6250929d tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1672 microversion: 2.20 time: 0.276133 Aug 23 22:32:09.739635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 600/928] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:09 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1672 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:10.180389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4c7d6087-8ffb-4c34-a3bb-d6b434d552f3 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f902c270f70>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:10.244501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4c7d6087-8ffb-4c34-a3bb-d6b434d552f3 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6fa3b16a-e278-4e0e-87d3-464367548d97" status: 200 len: 351 microversion: 2.1 time: 0.067653 Aug 23 22:32:10.245371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 601/929] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:32:10 2022] GET /compute/v2.1/os-volumes/6fa3b16a-e278-4e0e-87d3-464367548d97 => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:32:10.260494 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c1cc7600-616b-4ee4-9ec0-b4f8ab9ea9b5 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f902c1294c0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:10.357410 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c1cc7600-616b-4ee4-9ec0-b4f8ab9ea9b5 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.100800 Aug 23 22:32:10.358247 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 602/930] 10.222.0.88 () {58 vars in 1134 bytes} [Tue Aug 23 22:32:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:10.373937 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-10e9bb0d-e55d-41d1-bf64-4628c54905e7 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f902c0c79d0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:10.463394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-10e9bb0d-e55d-41d1-bf64-4628c54905e7 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093693 Aug 23 22:32:10.463982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 603/931] 10.222.0.88 () {58 vars in 1149 bytes} [Tue Aug 23 22:32:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:32:10.477350 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-adf27469-89e8-4122-a15f-046856cd1d3d tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f902c24b3a0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:10.590358 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-adf27469-89e8-4122-a15f-046856cd1d3d tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.116423 Aug 23 22:32:10.591399 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 604/932] 10.222.0.88 () {58 vars in 1134 bytes} [Tue Aug 23 22:32:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:10.608230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0c6f7d22-d021-4e73-9186-a93569c154b6 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f902c270280>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:10.708715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0c6f7d22-d021-4e73-9186-a93569c154b6 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105081 Aug 23 22:32:10.709362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 605/933] 10.222.0.88 () {58 vars in 1167 bytes} [Tue Aug 23 22:32:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:32:10.726507 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-895334d0-43c1-4ac4-9a4e-81c0ff7f56df tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f902c4d7ee0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:10.833627 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-895334d0-43c1-4ac4-9a4e-81c0ff7f56df tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.111923 Aug 23 22:32:10.834344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 606/934] 10.222.0.88 () {58 vars in 1170 bytes} [Tue Aug 23 22:32:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:32:10.839546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:10.840301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:10.848617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:10.849305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:10.849851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:10.850944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:10.851745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:10.852501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:11.196438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:11.210127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:11.213389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:11.215753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-dce16d0d-1b61-4bad-bbeb-d2703bd6ab86 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.379939 Aug 23 22:32:11.216801 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 607/935] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:10 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:11.228299 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-525266d0-4be4-4f46-8e78-9e76a2ee853e tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f902c0df1f0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:11.348955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-525266d0-4be4-4f46-8e78-9e76a2ee853e tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.130163 Aug 23 22:32:11.350428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 608/936] 10.222.0.88 () {58 vars in 1155 bytes} [Tue Aug 23 22:32:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:11.368336 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b629c684-a019-4ad5-beaf-0a074c0396ac tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f901fff7d30>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:11.538434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b629c684-a019-4ad5-beaf-0a074c0396ac tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.177141 Aug 23 22:32:11.539581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 609/937] 10.222.0.88 () {58 vars in 1188 bytes} [Tue Aug 23 22:32:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:32:11.561418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c03f7ec6-598f-4939-9b66-93fec5bced33 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] Calling method '.version_select at 0x7f901fec73a0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:11.678728 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c03f7ec6-598f-4939-9b66-93fec5bced33 tempest-VolumesTestJSON-360365432 tempest-VolumesTestJSON-360365432-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.123730 Aug 23 22:32:11.680182 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 610/938] 10.222.0.88 () {58 vars in 1155 bytes} [Tue Aug 23 22:32:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:12.244427 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:12.245072 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:12.252078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:12.252889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:12.253356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:12.254081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:12.254537 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:12.254965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:12.456105 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:12.473971 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:12.478474 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:12.482297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f0c7b0fb-a339-4f2e-a07c-6e0e8686b69e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.242591 Aug 23 22:32:12.483528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 611/939] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:12 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:13.518774 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:13.519724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:13.526617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:13.527096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:13.527522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:13.528220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:13.528661 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:13.529191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:13.688435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:13.697557 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:13.699403 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:13.700674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d8e86741-a03f-43e7-8647-f5db0c763da4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.190078 Aug 23 22:32:13.701350 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 612/940] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:13 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:14.725931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:14.726683 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:14.733876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:14.734366 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:14.734798 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:14.735581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:14.736034 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:14.736642 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:14.901742 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:14.910981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:14.912504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:14.913728 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-16717d9e-d7d0-4907-afb9-2053ca52db43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.191842 Aug 23 22:32:14.914287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 613/941] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:14 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:15.939030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:15.941434 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:15.957713 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:15.958244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:15.958718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:15.959470 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:15.960123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:15.960558 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:16.160963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:16.171232 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:16.173189 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:16.174963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-128f0e04-b1e0-4543-867a-c00387f10dbe tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.240441 Aug 23 22:32:16.175543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 614/942] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:15 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:17.203822 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:17.205905 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:17.214549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:17.215482 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:17.216082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:17.217248 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:17.218620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:17.220796 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:17.523972 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:17.552650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:17.554620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:17.556344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b3c8c61e-bf16-45ef-b383-977ba44209ab tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.357793 Aug 23 22:32:17.557493 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 615/943] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:17 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:18.592940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:18.596256 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:18.605882 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:18.607488 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:18.609529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:18.611423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:18.612243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:18.613006 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:18.824969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:18.834635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:18.836132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:18.837356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-77cf75e3-3f9b-412d-b69e-8bb446bffe43 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.251015 Aug 23 22:32:18.848403 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 616/944] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:18 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:19.871306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:19.872593 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:19.884068 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:19.885279 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:19.886446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:19.887882 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:19.888879 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:19.889817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:20.121865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:20.132578 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:20.135266 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:20.136483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f1382352-0f48-4a7f-8d91-1ab2a8725ad4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.274829 Aug 23 22:32:20.137498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 617/945] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:19 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:21.160093 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:21.160916 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:21.168118 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:21.168600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:21.169035 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:21.169810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:21.170254 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:21.170679 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:21.340924 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:21.346163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:21.352561 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:21.354218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:21.355526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4c88e4eb-164e-4a7f-8faf-13e6944335a8 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.199974 Aug 23 22:32:21.356061 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 618/946] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:21 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:21.430087 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-00cbc14d-3a93-4083-a967-3e0721622212 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:21.430769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-00cbc14d-3a93-4083-a967-3e0721622212 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:21.439236 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-00cbc14d-3a93-4083-a967-3e0721622212 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:21.439769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-00cbc14d-3a93-4083-a967-3e0721622212 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:21.443821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-00cbc14d-3a93-4083-a967-3e0721622212 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:21.443821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-00cbc14d-3a93-4083-a967-3e0721622212 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:21.443821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-00cbc14d-3a93-4083-a967-3e0721622212 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:21.443821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-00cbc14d-3a93-4083-a967-3e0721622212 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:21.472363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-00cbc14d-3a93-4083-a967-3e0721622212 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/ips" status: 200 len: 148 microversion: 2.1 time: 0.048648 Aug 23 22:32:21.472986 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 619/947] 10.222.0.88 () {58 vars in 1248 bytes} [Tue Aug 23 22:32:21 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:32:22.393085 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:22.393833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:22.404106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:22.404106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:22.404106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:22.404106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:22.404602 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:22.404602 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:22.553515 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:22.563377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:22.564979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:22.566242 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b6687059-de97-4c92-8e08-47ea5ab94525 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.177356 Aug 23 22:32:22.566876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 620/948] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:22 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:22.940697 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5e3132fe-cb9b-409d-bf95-8a1b81919b85 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be8c0c51-fd4c-4f60-b462-bfd8da35870a"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:22.943113 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5e3132fe-cb9b-409d-bf95-8a1b81919b85 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:22.949216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e3132fe-cb9b-409d-bf95-8a1b81919b85 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:22.949750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e3132fe-cb9b-409d-bf95-8a1b81919b85 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:22.950200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e3132fe-cb9b-409d-bf95-8a1b81919b85 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:22.950872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e3132fe-cb9b-409d-bf95-8a1b81919b85 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:22.951328 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e3132fe-cb9b-409d-bf95-8a1b81919b85 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:22.951750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e3132fe-cb9b-409d-bf95-8a1b81919b85 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:23.378479 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5e3132fe-cb9b-409d-bf95-8a1b81919b85 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "POST /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442902 Aug 23 22:32:23.379107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 621/949] 10.222.0.88 () {60 vars in 1323 bytes} [Tue Aug 23 22:32:22 2022] POST /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:32:23.591876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:23.592717 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:23.600211 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:23.600702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:23.601186 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:23.601905 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:23.602361 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:23.602963 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:23.780881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:23.805981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:23.807758 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:23.809690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-76d5afde-a534-47bc-a36b-75cad21c1210 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.222664 Aug 23 22:32:23.823050 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 622/950] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:23 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:24.835169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:24.836256 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:24.843740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:24.844917 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:24.845387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:24.846169 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:24.846626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:24.847056 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:25.096692 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:25.115331 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:25.118975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:25.122938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-74f95b75-709e-4a48-afdb-672587a901be tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.291634 Aug 23 22:32:25.124053 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 623/951] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:24 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:26.153476 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:26.155944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:26.168651 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:26.169824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:26.170740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:26.175180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:26.175180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:26.175180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:26.495535 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:26.515019 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:26.522379 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:26.525103 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-36648dcd-9e22-4899-8f1f-2f0bce3a1353 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.379449 Aug 23 22:32:26.526146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 624/952] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:26 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:26.738049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-51ab4566-1dbb-40e2-a1de-ef88a15f7baf req-faa702ff-3037-47b2-9964-a75b2f49a878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84b4a2f-7ca4-4281-84ff-69efdc3897a2", "name": "network-vif-plugged", "status": "completed", "tag": "2145ae08-8d67-45d5-bc60-d74ff38d6e5a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:26.757971 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-51ab4566-1dbb-40e2-a1de-ef88a15f7baf req-faa702ff-3037-47b2-9964-a75b2f49a878 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:26.758563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-51ab4566-1dbb-40e2-a1de-ef88a15f7baf req-faa702ff-3037-47b2-9964-a75b2f49a878 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:26.759388 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-51ab4566-1dbb-40e2-a1de-ef88a15f7baf req-faa702ff-3037-47b2-9964-a75b2f49a878 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:26.800510 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-51ab4566-1dbb-40e2-a1de-ef88a15f7baf req-faa702ff-3037-47b2-9964-a75b2f49a878 service nova] Creating event network-vif-plugged:2145ae08-8d67-45d5-bc60-d74ff38d6e5a for instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 on hv-cinder-85032 Aug 23 22:32:26.807755 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-51ab4566-1dbb-40e2-a1de-ef88a15f7baf req-faa702ff-3037-47b2-9964-a75b2f49a878 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077460 Aug 23 22:32:26.809557 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 625/953] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:32:27.558883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:27.560287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:27.568124 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:27.568735 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:27.569268 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:27.570043 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:27.570554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:27.571040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:27.736832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:27.749226 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:27.751966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:27.753866 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bfd268b2-1dce-41a9-87f5-b595c1433a3b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.204837 Aug 23 22:32:27.754437 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 626/954] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:27 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:28.785993 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:28.788508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:28.809530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:28.811509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:28.812216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:28.814030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:28.815935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:28.816899 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:29.030608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:29.042325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:29.042932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:29.044145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-edda7845-e527-473f-8e81-249bc9acb6eb tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1730 microversion: 2.20 time: 0.268734 Aug 23 22:32:29.052858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 627/955] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:28 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1730 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:32:30.069518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:30.070511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:30.078923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:30.079426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:30.080071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:30.080822 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:30.081307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:30.081736 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:30.285480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:30.302344 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:30.305827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:30.309268 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e2a3feba-77fe-45e6-a7b7-cc2941131c40 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1717 microversion: 2.20 time: 0.243579 Aug 23 22:32:30.310452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 628/956] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:32:30 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1717 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:32:31.285383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b717f4dc-1711-4cd0-b95c-3c6ae4a67ed8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:31.286196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b717f4dc-1711-4cd0-b95c-3c6ae4a67ed8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:31.293276 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b717f4dc-1711-4cd0-b95c-3c6ae4a67ed8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:31.293769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b717f4dc-1711-4cd0-b95c-3c6ae4a67ed8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:31.294193 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b717f4dc-1711-4cd0-b95c-3c6ae4a67ed8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:31.294897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b717f4dc-1711-4cd0-b95c-3c6ae4a67ed8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:31.295349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b717f4dc-1711-4cd0-b95c-3c6ae4a67ed8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:31.295839 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b717f4dc-1711-4cd0-b95c-3c6ae4a67ed8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:31.397268 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-b717f4dc-1711-4cd0-b95c-3c6ae4a67ed8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lazy-loading 'services' on Instance uuid c0f17a50-b5b6-49b4-a726-04c85ea730f7 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:32:31.488184 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b717f4dc-1711-4cd0-b95c-3c6ae4a67ed8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/os-volume_attachments/be8c0c51-fd4c-4f60-b462-bfd8da35870a" status: 202 len: 0 microversion: 2.1 time: 0.206921 Aug 23 22:32:31.489200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 629/957] 10.222.0.88 () {58 vars in 1416 bytes} [Tue Aug 23 22:32:31 2022] DELETE /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/os-volume_attachments/be8c0c51-fd4c-4f60-b462-bfd8da35870a => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:32:31.498500 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-79fe3f93-7d5b-4d76-a3a9-d37b7492dd1f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:31.501905 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-79fe3f93-7d5b-4d76-a3a9-d37b7492dd1f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:31.510080 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-79fe3f93-7d5b-4d76-a3a9-d37b7492dd1f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:31.510949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-79fe3f93-7d5b-4d76-a3a9-d37b7492dd1f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:31.511708 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-79fe3f93-7d5b-4d76-a3a9-d37b7492dd1f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:31.512832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-79fe3f93-7d5b-4d76-a3a9-d37b7492dd1f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:31.513455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-79fe3f93-7d5b-4d76-a3a9-d37b7492dd1f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:31.514040 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-79fe3f93-7d5b-4d76-a3a9-d37b7492dd1f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:31.550822 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-79fe3f93-7d5b-4d76-a3a9-d37b7492dd1f tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056009 Aug 23 22:32:31.551219 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 630/958] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:32:31 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:32:32.570998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b91b14a9-f827-4747-89ca-cd039be0edbd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:32.576921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b91b14a9-f827-4747-89ca-cd039be0edbd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:32.591007 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b91b14a9-f827-4747-89ca-cd039be0edbd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:32.591623 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b91b14a9-f827-4747-89ca-cd039be0edbd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:32.592229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b91b14a9-f827-4747-89ca-cd039be0edbd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:32.592985 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b91b14a9-f827-4747-89ca-cd039be0edbd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:32.593478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b91b14a9-f827-4747-89ca-cd039be0edbd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:32.594584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b91b14a9-f827-4747-89ca-cd039be0edbd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:32.659642 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b91b14a9-f827-4747-89ca-cd039be0edbd tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096522 Aug 23 22:32:32.660711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 631/959] 10.222.0.88 () {58 vars in 1302 bytes} [Tue Aug 23 22:32:32 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 22:32:32.746089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c8cead06-31f8-46ca-85b4-de209fbdf4b1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:32.746989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c8cead06-31f8-46ca-85b4-de209fbdf4b1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:32.755540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c8cead06-31f8-46ca-85b4-de209fbdf4b1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:32.756098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c8cead06-31f8-46ca-85b4-de209fbdf4b1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:32.756545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c8cead06-31f8-46ca-85b4-de209fbdf4b1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:32.757314 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c8cead06-31f8-46ca-85b4-de209fbdf4b1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:32.757767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c8cead06-31f8-46ca-85b4-de209fbdf4b1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:32.758186 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c8cead06-31f8-46ca-85b4-de209fbdf4b1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:32.803414 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c8cead06-31f8-46ca-85b4-de209fbdf4b1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:32:32.872132 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:32.926656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c8cead06-31f8-46ca-85b4-de209fbdf4b1 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 204 len: 0 microversion: 2.1 time: 0.188106 Aug 23 22:32:32.927263 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 632/960] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:32:32 2022] DELETE /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:32:32.936919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-df98f740-3aa7-4baf-8b58-58d18b24dd4d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:32.936919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-df98f740-3aa7-4baf-8b58-58d18b24dd4d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:32.946276 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-df98f740-3aa7-4baf-8b58-58d18b24dd4d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:32.946771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-df98f740-3aa7-4baf-8b58-58d18b24dd4d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:32.947204 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-df98f740-3aa7-4baf-8b58-58d18b24dd4d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:32.947915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-df98f740-3aa7-4baf-8b58-58d18b24dd4d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:32.948409 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-df98f740-3aa7-4baf-8b58-58d18b24dd4d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:32.948835 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-df98f740-3aa7-4baf-8b58-58d18b24dd4d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:33.133611 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-df98f740-3aa7-4baf-8b58-58d18b24dd4d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:33.148154 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-df98f740-3aa7-4baf-8b58-58d18b24dd4d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1678 microversion: 2.1 time: 0.215411 Aug 23 22:32:33.149130 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 633/961] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:32 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:34.177128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d0b79269-abbf-43ef-af51-1c613ff60f7d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:34.178333 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d0b79269-abbf-43ef-af51-1c613ff60f7d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:34.185497 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d0b79269-abbf-43ef-af51-1c613ff60f7d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:34.185863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d0b79269-abbf-43ef-af51-1c613ff60f7d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:34.186298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d0b79269-abbf-43ef-af51-1c613ff60f7d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:34.187037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d0b79269-abbf-43ef-af51-1c613ff60f7d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:34.188112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d0b79269-abbf-43ef-af51-1c613ff60f7d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:34.188615 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d0b79269-abbf-43ef-af51-1c613ff60f7d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:34.401114 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d0b79269-abbf-43ef-af51-1c613ff60f7d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:34.412030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d0b79269-abbf-43ef-af51-1c613ff60f7d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1678 microversion: 2.1 time: 0.240316 Aug 23 22:32:34.412707 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 634/962] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:34 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:35.438989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9d6d7956-c214-4b55-bd30-401e5b8903b8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:35.439935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9d6d7956-c214-4b55-bd30-401e5b8903b8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:35.451997 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d6d7956-c214-4b55-bd30-401e5b8903b8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:35.453496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d6d7956-c214-4b55-bd30-401e5b8903b8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:35.454343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d6d7956-c214-4b55-bd30-401e5b8903b8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:35.455469 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d6d7956-c214-4b55-bd30-401e5b8903b8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:35.456209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d6d7956-c214-4b55-bd30-401e5b8903b8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:35.457530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9d6d7956-c214-4b55-bd30-401e5b8903b8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:35.582106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9d6d7956-c214-4b55-bd30-401e5b8903b8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:35.601754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9d6d7956-c214-4b55-bd30-401e5b8903b8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1611 microversion: 2.1 time: 0.167916 Aug 23 22:32:35.602460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 635/963] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:35 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1611 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:32:35.965042 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-fe3417cc-4807-455d-bfe6-d07640d60e9f req-9b56b4b3-80d4-4b25-9888-fb8dbe6098c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f17a50-b5b6-49b4-a726-04c85ea730f7", "name": "network-vif-deleted", "tag": "4124fc99-9dcd-4dbc-b245-3aa44b05b837"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:32:35.984846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-fe3417cc-4807-455d-bfe6-d07640d60e9f req-9b56b4b3-80d4-4b25-9888-fb8dbe6098c2 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:35.986572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-fe3417cc-4807-455d-bfe6-d07640d60e9f req-9b56b4b3-80d4-4b25-9888-fb8dbe6098c2 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:35.987521 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-fe3417cc-4807-455d-bfe6-d07640d60e9f req-9b56b4b3-80d4-4b25-9888-fb8dbe6098c2 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:36.004694 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-fe3417cc-4807-455d-bfe6-d07640d60e9f req-9b56b4b3-80d4-4b25-9888-fb8dbe6098c2 service nova] Creating event network-vif-deleted:4124fc99-9dcd-4dbc-b245-3aa44b05b837 for instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 on hv-cinder-85032 Aug 23 22:32:36.012372 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-fe3417cc-4807-455d-bfe6-d07640d60e9f req-9b56b4b3-80d4-4b25-9888-fb8dbe6098c2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055198 Aug 23 22:32:36.016135 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 636/964] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:32:36.643274 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:36.646250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:36.659382 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:36.660854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:36.662053 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:36.663714 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:36.664934 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:36.666103 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:36.721041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:36.722527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:36.723402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:36.724388 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lazy-loading 'fault' on Instance uuid c0f17a50-b5b6-49b4-a726-04c85ea730f7 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:32:36.806100 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db1a9a77be6452991ec4f99af814e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0fc1c15f821495e9883814ffc7aed78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:32:36.819383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a273754c-1d02-44ac-9d2e-421e314f1388 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 200 len: 1330 microversion: 2.1 time: 0.185527 Aug 23 22:32:36.820383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 637/965] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:36 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 1330 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:32:37.852961 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:37.853811 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:37.861980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:37.862466 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:37.862897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:37.864061 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:37.864699 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:37.865164 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:37.886848 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 HTTP/1.1 Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:32:37.890098 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:37.893146 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'c0f17a50-b5b6-49b4-a726-04c85ea730f7'} Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:32:37.894508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:37.896834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:37.900175 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:32:37.900175 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ce6481a9-8ec2-4a35-9414-27d02a9e3bf4 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 404 len: 111 microversion: 2.1 time: 0.044020 Aug 23 22:32:37.900175 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 638/966] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:37 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:32:37.907009 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7b380e5b-d8b2-43d0-ad8b-f295287a8325 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '.version_select at 0x7f902c240ca0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:37.936974 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7b380e5b-d8b2-43d0-ad8b-f295287a8325 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-13725971" status: 202 len: 0 microversion: 2.1 time: 0.036230 Aug 23 22:32:37.938962 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 639/967] 10.222.0.88 () {58 vars in 1215 bytes} [Tue Aug 23 22:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-13725971 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:32:40.204355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:40.205627 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:40.208990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:40.222569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:40.223068 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:40.223564 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:40.224586 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:40.225312 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:40.225750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:40.247405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 HTTP/1.1 Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:32:40.251252 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:40.253846 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'c0f17a50-b5b6-49b4-a726-04c85ea730f7'} Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:32:40.255554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:40.257094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:40.259814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:32:40.259814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2132a839-cb68-456c-a11b-45fa03a05a78 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 404 len: 111 microversion: 2.1 time: 0.055295 Aug 23 22:32:40.259814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 640/968] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:32:40 2022] DELETE /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:32:40.264561 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:40.265286 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c0f17a50-b5b6-49b4-a726-04c85ea730f7] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:40.275648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:40.276562 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:40.277383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:40.278759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:40.279607 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:40.280396 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:40.304229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 HTTP/1.1 Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:32:40.305856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:40.308387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'c0f17a50-b5b6-49b4-a726-04c85ea730f7'} Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:32:40.309803 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. Aug 23 22:32:40.312209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:40.314748 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance c0f17a50-b5b6-49b4-a726-04c85ea730f7 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:32:40.314748 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-af12e0a4-17d3-41bd-b4a9-7f1d231d932d tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7" status: 404 len: 111 microversion: 2.1 time: 0.047742 Aug 23 22:32:40.314748 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 641/969] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:40 2022] GET /compute/v2.1/servers/c0f17a50-b5b6-49b4-a726-04c85ea730f7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:32:41.522742 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:41.523690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:41.530070 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:41.531349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:41.531556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:41.532644 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:41.533138 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:41.533682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:41.551016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 HTTP/1.1 Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:32:41.552603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:32:41.554196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'c789ef3c-a649-4967-a49e-e8ce958cc666'} Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:32:41.555117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:32:41.556585 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.558131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:32:41.558131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d72a932f-b6f7-4b7a-b393-b5dcf64148a8 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 404 len: 111 microversion: 2.1 time: 0.035348 Aug 23 22:32:41.558131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 642/970] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:32:41 2022] DELETE /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:32:41.563140 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:41.563834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: c789ef3c-a649-4967-a49e-e8ce958cc666] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:41.570741 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:41.571257 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:41.571690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:41.572421 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:41.572873 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:41.573329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:41.588428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 HTTP/1.1 Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:32:41.590230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:32:41.594079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'c789ef3c-a649-4967-a49e-e8ce958cc666'} Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:32:41.599029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. Aug 23 22:32:41.601832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.605464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance c789ef3c-a649-4967-a49e-e8ce958cc666 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:32:41.605464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9ed2b816-098a-40cf-9087-e852332aa8c7 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666" status: 404 len: 111 microversion: 2.1 time: 0.032828 Aug 23 22:32:41.605464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 643/971] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:41 2022] GET /compute/v2.1/servers/c789ef3c-a649-4967-a49e-e8ce958cc666 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:32:41.605901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:41.606210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:41.615911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:41.616404 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:41.616923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:41.618024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:41.618351 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:41.618608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:41.635538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 HTTP/1.1 Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:32:41.637452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:32:41.639574 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'a5b73e6f-743c-4663-9555-2df628611896'} Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:32:41.640770 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:32:41.642775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.644684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:32:41.644684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f6439940-fd14-406b-99c6-23392282f7af tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 404 len: 111 microversion: 2.1 time: 0.039250 Aug 23 22:32:41.644684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 644/972] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:32:41 2022] DELETE /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:32:41.651273 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:41.652616 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: a5b73e6f-743c-4663-9555-2df628611896] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:41.664588 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:41.665216 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:41.665759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:41.666766 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:41.667266 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:41.667920 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:41.687667 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 HTTP/1.1 Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:32:41.689543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:32:41.692975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'a5b73e6f-743c-4663-9555-2df628611896'} Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:32:41.695188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. Aug 23 22:32:41.698919 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:41.701584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance a5b73e6f-743c-4663-9555-2df628611896 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:32:41.701584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e59650b1-8292-4b93-a41c-aed350089db6 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896" status: 404 len: 111 microversion: 2.1 time: 0.045356 Aug 23 22:32:41.701584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 645/973] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:41 2022] GET /compute/v2.1/servers/a5b73e6f-743c-4663-9555-2df628611896 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:32:42.878039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:42.880471 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:42.889798 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:42.890446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:42.890933 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:42.891687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:42.892177 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:42.892614 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:42.909529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 HTTP/1.1 Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:32:42.911545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:32:42.914740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '8a32adbd-853b-47ce-b461-e82363494a37'} Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:32:42.915678 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:32:42.916927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:42.918290 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:32:42.918290 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2df82afa-b525-4b6a-a936-a2067ce5c266 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 404 len: 111 microversion: 2.1 time: 0.041630 Aug 23 22:32:42.918290 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 646/974] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:32:42 2022] DELETE /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:32:42.924690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:32:42.925752 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] [instance: 8a32adbd-853b-47ce-b461-e82363494a37] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:32:42.932559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:42.933044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:42.933510 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:42.934213 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:32:42.934657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:32:42.935072 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:32:42.955439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] HTTP exception thrown: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Request method failure captured: Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 HTTP/1.1 Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOoElJidZYXzkm3Ycrj0-gkQGvFzPMpxjnU--cnOY2L_KDDAr3Ca21hg12_9qdQB2j8BXC4h5ctzwmhwQ2X8oFwyf_wS6njzM2ot6qki0coUAVDqEzZU4rFEd3JtH1NySd9DhNV0Dd9Shd9KFlCtpvl-M0LW7lGtwGW5U0c3NSNrG0 Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:32:42.957002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0fc1c15f821495e9883814ffc7aed78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0fc1c15f821495e9883814ffc7aed78"}]}] Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: c0fc1c15f821495e9883814ffc7aed78 Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1531829796 Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1db1a9a77be6452991ec4f99af814e7a Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeNegativeTest-1531829796-project Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:32:42.959813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '8a32adbd-853b-47ce-b461-e82363494a37'} Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:32:42.961553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. Aug 23 22:32:42.964106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:32:42.966464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] Returning 404 to user: Instance 8a32adbd-853b-47ce-b461-e82363494a37 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:32:42.966464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b7fab741-56ce-4663-816d-6f9e69f3f868 tempest-AttachVolumeNegativeTest-1531829796 tempest-AttachVolumeNegativeTest-1531829796-project] 10.222.0.88 "GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37" status: 404 len: 111 microversion: 2.1 time: 0.040314 Aug 23 22:32:42.966464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 647/975] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:32:42 2022] GET /compute/v2.1/servers/8a32adbd-853b-47ce-b461-e82363494a37 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:33:03.915447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5c244b0a-1451-42cb-a7b2-cc548d83644b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:03.917817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5c244b0a-1451-42cb-a7b2-cc548d83644b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:03.920685 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=15 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:03.921600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=46 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:03.928206 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5c244b0a-1451-42cb-a7b2-cc548d83644b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:03.928695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5c244b0a-1451-42cb-a7b2-cc548d83644b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:03.929154 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5c244b0a-1451-42cb-a7b2-cc548d83644b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:03.929859 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5c244b0a-1451-42cb-a7b2-cc548d83644b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:03.930307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5c244b0a-1451-42cb-a7b2-cc548d83644b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:03.930734 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5c244b0a-1451-42cb-a7b2-cc548d83644b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:03.968480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5c244b0a-1451-42cb-a7b2-cc548d83644b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056004 Aug 23 22:33:03.969487 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 648/976] 10.222.0.88 () {60 vars in 1343 bytes} [Tue Aug 23 22:33:03 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:04.065458 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6afc4ccf-70c0-4f98-aa12-6efc17fdf74e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:04.066109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6afc4ccf-70c0-4f98-aa12-6efc17fdf74e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:04.074238 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6afc4ccf-70c0-4f98-aa12-6efc17fdf74e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:04.074819 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6afc4ccf-70c0-4f98-aa12-6efc17fdf74e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:04.075272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6afc4ccf-70c0-4f98-aa12-6efc17fdf74e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:04.076036 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6afc4ccf-70c0-4f98-aa12-6efc17fdf74e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:04.078063 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6afc4ccf-70c0-4f98-aa12-6efc17fdf74e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:04.078063 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6afc4ccf-70c0-4f98-aa12-6efc17fdf74e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:04.115933 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6afc4ccf-70c0-4f98-aa12-6efc17fdf74e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:33:04.257902 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6afc4ccf-70c0-4f98-aa12-6efc17fdf74e tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 204 len: 0 microversion: 2.20 time: 0.197747 Aug 23 22:33:04.259130 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 649/977] 10.222.0.88 () {60 vars in 1280 bytes} [Tue Aug 23 22:33:04 2022] DELETE /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 22:33:04.270141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:04.270857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:04.277819 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:04.278526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:04.279167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:04.279950 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:04.280974 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:04.281391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:04.495889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:04.506745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:04.508256 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:04.509511 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-301831b2-b44a-463b-96ec-09ce4655524f tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.245026 Aug 23 22:33:04.510082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 650/978] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:04 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 22:33:05.544785 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:05.545920 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:05.560763 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:05.561828 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:05.562030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:05.562652 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:05.563108 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:05.563530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:05.738197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:05.758944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:05.761247 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:05.762713 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5378467c-1bf2-4675-9a2b-84b85cf36aa4 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1723 microversion: 2.20 time: 0.222016 Aug 23 22:33:05.764028 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 651/979] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:05 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:33:06.804271 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:06.806608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:06.816750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:06.817968 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:06.818742 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:06.820070 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:06.821236 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:06.822008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:06.940577 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:06.959396 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:06.963405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06cd43d533f4621b0a69dbb0ef22dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be30316f0b745d783ec96bc983b2cb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:06.965670 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-369dc431-706e-4e2c-b65e-6d921ab2f56b tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 200 len: 1655 microversion: 2.20 time: 0.166893 Aug 23 22:33:06.974526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 652/980] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:06 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 1655 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 22:33:07.214244 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-3a796aa0-ced5-439e-ba54-4046d0e3f701 req-46657f70-c86f-4495-ba06-d155c97c11cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84b4a2f-7ca4-4281-84ff-69efdc3897a2", "name": "network-vif-deleted", "tag": "2145ae08-8d67-45d5-bc60-d74ff38d6e5a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:07.234830 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3a796aa0-ced5-439e-ba54-4046d0e3f701 req-46657f70-c86f-4495-ba06-d155c97c11cb service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:07.235653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3a796aa0-ced5-439e-ba54-4046d0e3f701 req-46657f70-c86f-4495-ba06-d155c97c11cb service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:07.236540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-3a796aa0-ced5-439e-ba54-4046d0e3f701 req-46657f70-c86f-4495-ba06-d155c97c11cb service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:07.254826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-3a796aa0-ced5-439e-ba54-4046d0e3f701 req-46657f70-c86f-4495-ba06-d155c97c11cb service nova] Creating event network-vif-deleted:2145ae08-8d67-45d5-bc60-d74ff38d6e5a for instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 on hv-cinder-85032 Aug 23 22:33:07.269575 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-3a796aa0-ced5-439e-ba54-4046d0e3f701 req-46657f70-c86f-4495-ba06-d155c97c11cb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054722 Aug 23 22:33:07.275321 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 653/981] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:33:08.006834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:08.006834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:08.019363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:08.020526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:08.021326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:08.022566 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:08.024872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:08.024872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:08.049754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] HTTP exception thrown: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Request method failure captured: Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 HTTP/1.1 Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOh2yvxaj-wiKmzJBWrXmHZzvMz3Op7M2I-YsvNdLZbHaAwQXvCxy4iZMuSOXr6Nn8ZjtDDWGLP4aud8q3Rfu0xBvAkS8CXTsDcT5K-AeXP0RgESEpA0qKnJ5plz5ySC2aItD9qdBcjnl9WUNXaCJDznJpMq8FtjMpspKEBUOIRQ5Y Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:33:08.052297 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}] Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: c06cd43d533f4621b0a69dbb0ef22dc4 Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:08.054706 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'd84b4a2f-7ca4-4281-84ff-69efdc3897a2'} Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:08.055499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:08.058897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:08.066041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Returning 404 to user: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:08.066041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f68844f2-5b6a-47c7-8d92-81739c9f6407 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 404 len: 111 microversion: 2.20 time: 0.055072 Aug 23 22:33:08.066041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 654/982] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:07 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 22:33:08.069211 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7f316f22-85db-4b0c-a6c7-f0b235855074 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '.version_select at 0x7f901fff7280>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:08.100016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7f316f22-85db-4b0c-a6c7-f0b235855074 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751245124" status: 204 len: 0 microversion: 2.20 time: 0.036535 Aug 23 22:33:08.102156 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 655/983] 10.222.0.88 () {60 vars in 1259 bytes} [Tue Aug 23 22:33:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751245124 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 22:33:10.895764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:10.896867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:10.906486 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:10.907382 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:10.908139 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:10.909128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:10.909688 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:10.910285 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:10.929411 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] HTTP exception thrown: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Request method failure captured: Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 HTTP/1.1 Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOh2yvxaj-wiKmzJBWrXmHZzvMz3Op7M2I-YsvNdLZbHaAwQXvCxy4iZMuSOXr6Nn8ZjtDDWGLP4aud8q3Rfu0xBvAkS8CXTsDcT5K-AeXP0RgESEpA0qKnJ5plz5ySC2aItD9qdBcjnl9WUNXaCJDznJpMq8FtjMpspKEBUOIRQ5Y Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:33:10.931674 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}] Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: c06cd43d533f4621b0a69dbb0ef22dc4 Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:10.940378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'd84b4a2f-7ca4-4281-84ff-69efdc3897a2'} Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:10.941475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:10.942969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:10.944308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Returning 404 to user: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:10.944308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-7ec03dbd-70fd-4e0a-b2a5-cdce851c7ce1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 404 len: 111 microversion: 2.20 time: 0.047060 Aug 23 22:33:10.944308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 656/984] 10.222.0.88 () {60 vars in 1280 bytes} [Tue Aug 23 22:33:10 2022] DELETE /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:33:10.954102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:10.955443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: d84b4a2f-7ca4-4281-84ff-69efdc3897a2] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:10.966989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:10.968046 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:10.968711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:10.970078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:10.970875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:10.971679 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:11.002064 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] HTTP exception thrown: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Request method failure captured: Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 HTTP/1.1 Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOh2yvxaj-wiKmzJBWrXmHZzvMz3Op7M2I-YsvNdLZbHaAwQXvCxy4iZMuSOXr6Nn8ZjtDDWGLP4aud8q3Rfu0xBvAkS8CXTsDcT5K-AeXP0RgESEpA0qKnJ5plz5ySC2aItD9qdBcjnl9WUNXaCJDznJpMq8FtjMpspKEBUOIRQ5Y Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:33:11.005287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}] Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: c06cd43d533f4621b0a69dbb0ef22dc4 Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:11.007260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'd84b4a2f-7ca4-4281-84ff-69efdc3897a2'} Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:11.008527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. Aug 23 22:33:11.011096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:11.012825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Returning 404 to user: Instance d84b4a2f-7ca4-4281-84ff-69efdc3897a2 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:11.012825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-14029b80-107b-4b91-9ef4-90e984ab08d1 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2" status: 404 len: 111 microversion: 2.20 time: 0.061241 Aug 23 22:33:11.012825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 657/985] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:10 2022] GET /compute/v2.1/servers/d84b4a2f-7ca4-4281-84ff-69efdc3897a2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:33:12.259647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:12.260514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:12.270386 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:12.271355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:12.271355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:12.272026 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:12.272476 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:12.272896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:12.291801 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] HTTP exception thrown: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Request method failure captured: Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf HTTP/1.1 Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOh2yvxaj-wiKmzJBWrXmHZzvMz3Op7M2I-YsvNdLZbHaAwQXvCxy4iZMuSOXr6Nn8ZjtDDWGLP4aud8q3Rfu0xBvAkS8CXTsDcT5K-AeXP0RgESEpA0qKnJ5plz5ySC2aItD9qdBcjnl9WUNXaCJDznJpMq8FtjMpspKEBUOIRQ5Y Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:33:12.294391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}] Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: c06cd43d533f4621b0a69dbb0ef22dc4 Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:33:12.297483 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '80b697da-19f2-459e-a57e-e386523e4bcf'} Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:12.298929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:33:12.301915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:12.305529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Returning 404 to user: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:12.305529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b155322c-bca4-4f1a-ad2e-96273b0697d6 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "DELETE /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 404 len: 111 microversion: 2.20 time: 0.044595 Aug 23 22:33:12.305529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 658/986] 10.222.0.88 () {60 vars in 1280 bytes} [Tue Aug 23 22:33:12 2022] DELETE /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 22:33:12.310362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:12.311584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] [instance: 80b697da-19f2-459e-a57e-e386523e4bcf] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:12.319428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:12.320087 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:12.320709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:12.321681 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:12.322327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:12.322938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:12.339911 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] HTTP exception thrown: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Request method failure captured: Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf HTTP/1.1 Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVOh2yvxaj-wiKmzJBWrXmHZzvMz3Op7M2I-YsvNdLZbHaAwQXvCxy4iZMuSOXr6Nn8ZjtDDWGLP4aud8q3Rfu0xBvAkS8CXTsDcT5K-AeXP0RgESEpA0qKnJ5plz5ySC2aItD9qdBcjnl9WUNXaCJDznJpMq8FtjMpspKEBUOIRQ5Y Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:33:12.341533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8be30316f0b745d783ec96bc983b2cb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8be30316f0b745d783ec96bc983b2cb1"}]}] Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 8be30316f0b745d783ec96bc983b2cb1 Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-294110738 Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: c06cd43d533f4621b0a69dbb0ef22dc4 Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-AttachVolumeShelveTestJSON-294110738-project Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:33:12.346439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '80b697da-19f2-459e-a57e-e386523e4bcf'} Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:12.347931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. Aug 23 22:33:12.350394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:12.354245 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] Returning 404 to user: Instance 80b697da-19f2-459e-a57e-e386523e4bcf could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:12.354245 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3afbfaee-076c-48c8-b0c8-6ab59da39bb3 tempest-AttachVolumeShelveTestJSON-294110738 tempest-AttachVolumeShelveTestJSON-294110738-project] 10.222.0.88 "GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf" status: 404 len: 111 microversion: 2.20 time: 0.038636 Aug 23 22:33:12.354842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 659/987] 10.222.0.88 () {60 vars in 1277 bytes} [Tue Aug 23 22:33:12 2022] GET /compute/v2.1/servers/80b697da-19f2-459e-a57e-e386523e4bcf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 22:33:19.751857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d6de3ea9-f8b7-442e-b34e-d7e3f207c18a tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Action: 'create', calling method: .version_select at 0x7f901ff31e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1842073804", "metadata": {"Type": "work"}}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:20.222974 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d6de3ea9-f8b7-442e-b34e-d7e3f207c18a tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.692821 Aug 23 22:33:20.231137 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 660/988] 10.222.0.88 () {60 vars in 1156 bytes} [Tue Aug 23 22:33:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 695 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 23 22:33:20.236850 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2da9193c-20c9-457f-ae19-3edfcda7cc67 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Calling method '.version_select at 0x7f901fe07040>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:20.305369 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2da9193c-20c9-457f-ae19-3edfcda7cc67 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9" status: 200 len: 353 microversion: 2.1 time: 0.072639 Aug 23 22:33:20.306446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 661/989] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:33:20 2022] GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:33:21.328211 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b395b31f-9f77-4215-b6c7-4f1616a8218f tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Calling method '.version_select at 0x7f902e991e50>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:21.402358 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b395b31f-9f77-4215-b6c7-4f1616a8218f tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9" status: 200 len: 353 microversion: 2.1 time: 0.083166 Aug 23 22:33:21.403240 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 662/990] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:33:21 2022] GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:33:22.415840 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:22.418332 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:22.426045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-579a3019-38b9-4a97-8107-3aba978409c4 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Calling method '.version_select at 0x7f901fe0b820>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:22.521992 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-579a3019-38b9-4a97-8107-3aba978409c4 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9" status: 200 len: 353 microversion: 2.1 time: 0.106638 Aug 23 22:33:22.522981 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 663/991] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:33:22 2022] GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:33:23.544172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f382b791-c29a-4aca-95e1-80857dd4f8f0 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Calling method '.version_select at 0x7f901ff08790>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:23.609095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f382b791-c29a-4aca-95e1-80857dd4f8f0 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9" status: 200 len: 354 microversion: 2.1 time: 0.068773 Aug 23 22:33:23.610291 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 664/992] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:33:23 2022] GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9 => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:33:23.627700 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-48fa4d95-6649-45b4-a7b8-fb3870232999 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Calling method '.version_select at 0x7f901ffced30>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:23.698200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-48fa4d95-6649-45b4-a7b8-fb3870232999 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9" status: 200 len: 354 microversion: 2.1 time: 0.074954 Aug 23 22:33:23.699010 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 665/993] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:33:23 2022] GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9 => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:33:23.723975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-06089296-82b3-4c4a-a0d8-de3307fab2d5 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Calling method '.version_select at 0x7f901ff08c10>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:23.815886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-06089296-82b3-4c4a-a0d8-de3307fab2d5 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9" status: 202 len: 0 microversion: 2.1 time: 0.100996 Aug 23 22:33:23.816493 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 666/994] 10.222.0.88 () {58 vars in 1248 bytes} [Tue Aug 23 22:33:23 2022] DELETE /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:33:23.830458 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-18687993-3185-4a3c-958d-b0d18700d984 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Calling method '.version_select at 0x7f901fe0b790>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:23.923104 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-18687993-3185-4a3c-958d-b0d18700d984 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9" status: 200 len: 353 microversion: 2.1 time: 0.101790 Aug 23 22:33:23.924183 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 667/995] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:33:23 2022] GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:33:24.943810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-afc484fe-3693-4043-afd5-4a5d7745ccb7 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Calling method '.version_select at 0x7f901fff7820>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:24.998610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-afc484fe-3693-4043-afd5-4a5d7745ccb7 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] HTTP exception thrown: Volume 6889a62d-bed9-4cee-8291-b9be2dcc7ab9 could not be found. Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-afc484fe-3693-4043-afd5-4a5d7745ccb7 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Request method failure captured: Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9 HTTP/1.1 Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVWv4bo3pBnFj_fGmpDM5eUL0IwoWpEDkPHX5Imekf3Nv0C7z7L3Eqw6Kgq88RM0dSKIG1hNBsPjkQ-kbazKwX0wsc-HLP-MRNNnBWPLUMZEpHJ7K4HFysAJdqrHhLJlc4dd427gG13t3JjE-7dBCxQcfvK-KAPgq2kPFHChvn72dtA Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: cfac9263b7654b5eb4742ef2638dffc1 Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesGetTestJSON-1921797866 Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:33:25.003079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cfac9263b7654b5eb4742ef2638dffc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_cfac9263b7654b5eb4742ef2638dffc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/cfac9263b7654b5eb4742ef2638dffc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cfac9263b7654b5eb4742ef2638dffc1"}]}] Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesGetTestJSON-1921797866 Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: cfac9263b7654b5eb4742ef2638dffc1 Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesGetTestJSON-1921797866 Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesGetTestJSON-1921797866-project Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 1bc35c9f116d4de8a2f1bb5cccb81053 Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesGetTestJSON-1921797866-project Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Volume 6889a62d-bed9-4cee-8291-b9be2dcc7ab9 could not be found. Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '6889a62d-bed9-4cee-8291-b9be2dcc7ab9'} Aug 23 22:33:25.006218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6889a62d-bed9-4cee-8291-b9be2dcc7ab9 could not be found. (HTTP 404) (Request-ID: req-e49be98b-1a4a-407d-9352-36371352e607) Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:25.008020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 22:33:25.010395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6889a62d-bed9-4cee-8291-b9be2dcc7ab9 could not be found. Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 22:33:25.012701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6889a62d-bed9-4cee-8291-b9be2dcc7ab9 could not be found. Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6889a62d-bed9-4cee-8291-b9be2dcc7ab9 could not be found. Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-afc484fe-3693-4043-afd5-4a5d7745ccb7 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] Returning 404 to user: Volume 6889a62d-bed9-4cee-8291-b9be2dcc7ab9 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-afc484fe-3693-4043-afd5-4a5d7745ccb7 tempest-VolumesGetTestJSON-1921797866 tempest-VolumesGetTestJSON-1921797866-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9" status: 404 len: 109 microversion: 2.1 time: 0.070944 Aug 23 22:33:25.015935 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 668/996] 10.222.0.88 () {58 vars in 1245 bytes} [Tue Aug 23 22:33:24 2022] GET /compute/v2.1/os-volumes/6889a62d-bed9-4cee-8291-b9be2dcc7ab9 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:33:47.568683 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-dbbb5dd6-49b1-4202-ad97-733899fa5c3e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:47.569727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-dbbb5dd6-49b1-4202-ad97-733899fa5c3e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:47.582176 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbbb5dd6-49b1-4202-ad97-733899fa5c3e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:47.583060 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbbb5dd6-49b1-4202-ad97-733899fa5c3e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:47.583998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbbb5dd6-49b1-4202-ad97-733899fa5c3e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:47.585089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbbb5dd6-49b1-4202-ad97-733899fa5c3e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:47.585778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbbb5dd6-49b1-4202-ad97-733899fa5c3e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:47.586659 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-dbbb5dd6-49b1-4202-ad97-733899fa5c3e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:47.624087 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-dbbb5dd6-49b1-4202-ad97-733899fa5c3e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:33:47.756285 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-dbbb5dd6-49b1-4202-ad97-733899fa5c3e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 204 len: 0 microversion: 2.1 time: 0.191545 Aug 23 22:33:47.757677 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 669/997] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:33:47 2022] DELETE /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:33:47.772792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-93d56a85-9da1-40c9-a239-e3485bef058d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:47.774238 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-93d56a85-9da1-40c9-a239-e3485bef058d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:47.787069 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93d56a85-9da1-40c9-a239-e3485bef058d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:47.788065 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93d56a85-9da1-40c9-a239-e3485bef058d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:47.788926 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93d56a85-9da1-40c9-a239-e3485bef058d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:47.790552 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93d56a85-9da1-40c9-a239-e3485bef058d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:47.791651 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93d56a85-9da1-40c9-a239-e3485bef058d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:47.792424 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-93d56a85-9da1-40c9-a239-e3485bef058d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:47.964102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-93d56a85-9da1-40c9-a239-e3485bef058d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:47.975851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-93d56a85-9da1-40c9-a239-e3485bef058d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1576 microversion: 2.1 time: 0.210655 Aug 23 22:33:47.976444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 670/998] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:47 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:49.002343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4aed510c-5b7e-4d06-941a-c11bd351ce91 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:49.003067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4aed510c-5b7e-4d06-941a-c11bd351ce91 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:49.009798 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4aed510c-5b7e-4d06-941a-c11bd351ce91 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:49.010274 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4aed510c-5b7e-4d06-941a-c11bd351ce91 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:49.010703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4aed510c-5b7e-4d06-941a-c11bd351ce91 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:49.011393 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4aed510c-5b7e-4d06-941a-c11bd351ce91 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:49.011838 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4aed510c-5b7e-4d06-941a-c11bd351ce91 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:49.012253 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4aed510c-5b7e-4d06-941a-c11bd351ce91 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:49.190690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4aed510c-5b7e-4d06-941a-c11bd351ce91 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:49.202141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4aed510c-5b7e-4d06-941a-c11bd351ce91 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1576 microversion: 2.1 time: 0.204618 Aug 23 22:33:49.203220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 671/999] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:48 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:49.375207 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-883029747", "imageRef": "6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91", "flavorRef": "452"}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:49.436903 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] validate_networks() for None {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:33:49.892384 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:33:49.893633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:33:49.893633 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:33:49.894330 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:33:49.894673 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:33:49.905375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:49.905861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:49.906328 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:49.907036 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:49.907539 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:49.907913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:49.929272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Getting quotas for project a07e102f326541e2a89cfe541aa7a022. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:33:49.935541 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Getting quotas for user 086e60f669894290be19bd9b4b40d1d5 and project a07e102f326541e2a89cfe541aa7a022. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:33:49.951450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:33:49.954596 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ab4a4c0-dfc1-4c95-9606-4f71cdcdfc91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:33:50.020195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5a3ed69e-bc5d-4cf2-b733-900378c9f459 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647749 Aug 23 22:33:50.020195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 672/1000] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:33:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:33:50.031962 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a31e5e77-cb36-43e2-9d4f-1a8373623d26 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:50.033086 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a31e5e77-cb36-43e2-9d4f-1a8373623d26 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:50.123489 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a31e5e77-cb36-43e2-9d4f-1a8373623d26 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:50.134600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a31e5e77-cb36-43e2-9d4f-1a8373623d26 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1214 microversion: 2.1 time: 0.107575 Aug 23 22:33:50.136121 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 673/1001] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:50 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:50.237826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-874792d4-e78f-4d7b-b9f8-7fffd7fcf470 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:50.238464 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-874792d4-e78f-4d7b-b9f8-7fffd7fcf470 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:50.245318 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-874792d4-e78f-4d7b-b9f8-7fffd7fcf470 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:50.246010 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-874792d4-e78f-4d7b-b9f8-7fffd7fcf470 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:50.246793 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-874792d4-e78f-4d7b-b9f8-7fffd7fcf470 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:50.248143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-874792d4-e78f-4d7b-b9f8-7fffd7fcf470 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:50.248677 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-874792d4-e78f-4d7b-b9f8-7fffd7fcf470 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:50.249712 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-874792d4-e78f-4d7b-b9f8-7fffd7fcf470 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:50.606401 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-874792d4-e78f-4d7b-b9f8-7fffd7fcf470 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:50.624430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-874792d4-e78f-4d7b-b9f8-7fffd7fcf470 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1576 microversion: 2.1 time: 0.391330 Aug 23 22:33:50.625790 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 674/1002] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:50 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1576 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:51.156782 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3b8d0a1c-f770-430f-b342-e956000d9d7f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:51.158806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3b8d0a1c-f770-430f-b342-e956000d9d7f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:51.166679 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b8d0a1c-f770-430f-b342-e956000d9d7f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:51.167455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b8d0a1c-f770-430f-b342-e956000d9d7f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:51.168634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b8d0a1c-f770-430f-b342-e956000d9d7f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:51.170158 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b8d0a1c-f770-430f-b342-e956000d9d7f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:51.170817 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b8d0a1c-f770-430f-b342-e956000d9d7f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:51.171436 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3b8d0a1c-f770-430f-b342-e956000d9d7f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:51.311309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3b8d0a1c-f770-430f-b342-e956000d9d7f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:51.322489 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3b8d0a1c-f770-430f-b342-e956000d9d7f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1218 microversion: 2.1 time: 0.169954 Aug 23 22:33:51.323076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 675/1003] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:51 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:51.328222 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-0adffc35-34cc-488f-9d19-352150408d31 req-297f5495-f838-4af0-b2e8-ef33ba8fcfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e", "name": "network-vif-deleted", "tag": "21001569-2deb-472d-899a-71203a25df1a"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:51.338400 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0adffc35-34cc-488f-9d19-352150408d31 req-297f5495-f838-4af0-b2e8-ef33ba8fcfa4 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:51.338863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0adffc35-34cc-488f-9d19-352150408d31 req-297f5495-f838-4af0-b2e8-ef33ba8fcfa4 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:51.339283 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-0adffc35-34cc-488f-9d19-352150408d31 req-297f5495-f838-4af0-b2e8-ef33ba8fcfa4 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:51.351782 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-0adffc35-34cc-488f-9d19-352150408d31 req-297f5495-f838-4af0-b2e8-ef33ba8fcfa4 service nova] Creating event network-vif-deleted:21001569-2deb-472d-899a-71203a25df1a for instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e on hv-cinder-85032 Aug 23 22:33:51.357656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-0adffc35-34cc-488f-9d19-352150408d31 req-297f5495-f838-4af0-b2e8-ef33ba8fcfa4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032429 Aug 23 22:33:51.358315 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 676/1004] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:33:51.653223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-83e056f2-777c-4e4c-8a08-0a580635ce57 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:51.654238 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-83e056f2-777c-4e4c-8a08-0a580635ce57 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:51.665933 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83e056f2-777c-4e4c-8a08-0a580635ce57 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:51.666837 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83e056f2-777c-4e4c-8a08-0a580635ce57 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:51.668022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83e056f2-777c-4e4c-8a08-0a580635ce57 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:51.671074 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83e056f2-777c-4e4c-8a08-0a580635ce57 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:51.671923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83e056f2-777c-4e4c-8a08-0a580635ce57 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:51.672729 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-83e056f2-777c-4e4c-8a08-0a580635ce57 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:51.773833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-83e056f2-777c-4e4c-8a08-0a580635ce57 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:51.789323 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-83e056f2-777c-4e4c-8a08-0a580635ce57 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1509 microversion: 2.1 time: 0.143574 Aug 23 22:33:51.790821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 677/1005] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:51 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:52.344553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d281dbf9-ed28-48ea-bc29-c21de47bba1a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:52.345305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d281dbf9-ed28-48ea-bc29-c21de47bba1a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:52.352156 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d281dbf9-ed28-48ea-bc29-c21de47bba1a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:52.352646 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d281dbf9-ed28-48ea-bc29-c21de47bba1a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:52.353107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d281dbf9-ed28-48ea-bc29-c21de47bba1a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:52.353881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d281dbf9-ed28-48ea-bc29-c21de47bba1a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:52.354959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d281dbf9-ed28-48ea-bc29-c21de47bba1a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:52.354959 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d281dbf9-ed28-48ea-bc29-c21de47bba1a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:52.450504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d281dbf9-ed28-48ea-bc29-c21de47bba1a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:52.469711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d281dbf9-ed28-48ea-bc29-c21de47bba1a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1218 microversion: 2.1 time: 0.129350 Aug 23 22:33:52.470612 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 678/1006] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:52 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:52.827020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d01e9f62-9fb6-4f6e-9aa3-98225be01abb tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:52.827636 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d01e9f62-9fb6-4f6e-9aa3-98225be01abb tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:52.834188 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d01e9f62-9fb6-4f6e-9aa3-98225be01abb tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:52.835017 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d01e9f62-9fb6-4f6e-9aa3-98225be01abb tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:52.835209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d01e9f62-9fb6-4f6e-9aa3-98225be01abb tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:52.835827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d01e9f62-9fb6-4f6e-9aa3-98225be01abb tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:52.836294 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d01e9f62-9fb6-4f6e-9aa3-98225be01abb tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:52.836695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d01e9f62-9fb6-4f6e-9aa3-98225be01abb tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:52.956546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d01e9f62-9fb6-4f6e-9aa3-98225be01abb tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:52.972075 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d01e9f62-9fb6-4f6e-9aa3-98225be01abb tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 200 len: 1225 microversion: 2.1 time: 0.148990 Aug 23 22:33:52.985323 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 679/1007] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:52 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 1225 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:53.505253 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a9b45500-ff4f-4757-80fb-f99170a1a1f3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:53.506658 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a9b45500-ff4f-4757-80fb-f99170a1a1f3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:53.517895 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9b45500-ff4f-4757-80fb-f99170a1a1f3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:53.520076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9b45500-ff4f-4757-80fb-f99170a1a1f3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:53.520529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9b45500-ff4f-4757-80fb-f99170a1a1f3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:53.521468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9b45500-ff4f-4757-80fb-f99170a1a1f3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:53.521975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9b45500-ff4f-4757-80fb-f99170a1a1f3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:53.522495 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a9b45500-ff4f-4757-80fb-f99170a1a1f3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:53.687096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a9b45500-ff4f-4757-80fb-f99170a1a1f3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:53.699529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a9b45500-ff4f-4757-80fb-f99170a1a1f3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1284 microversion: 2.1 time: 0.199148 Aug 23 22:33:53.701454 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 680/1008] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:53 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:53.995672 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:53.996390 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:54.003338 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:54.003821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:54.004255 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:54.004960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:54.005620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:54.006059 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:54.020721 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] HTTP exception thrown: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Request method failure captured: Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e HTTP/1.1 Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVUHQ9KOiFkIhHHBItYgvG70HIWA8UE-WMaCGxfXiaQwiPqXTB-hymK87YMg2jRK8UvqLSgdgKz_cPJKtPbEcj4o_3_kCelNuDxrau8D6-S4gIFUMj39vwERq2LDIDbIX7xT2ZdeUlkuoUxg_HlOo4n_NR4FkTpRcxtUJ0oO9DdKwSc Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 77cc91a5c0bc4e5888460d7618594895 Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-TestVolumeBootPattern-468979576 Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:33:54.022445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/77cc91a5c0bc4e5888460d7618594895"}]}] Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-TestVolumeBootPattern-468979576 Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 77cc91a5c0bc4e5888460d7618594895 Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-TestVolumeBootPattern-468979576 Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-TestVolumeBootPattern-468979576-project Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: fa949e48248747369eefd74280441b75 Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-TestVolumeBootPattern-468979576-project Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:33:54.024718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e'} Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:33:54.026447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:33:54.029481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:33:54.032032 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Returning 404 to user: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:33:54.032032 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-182788c5-6ec3-450b-8f43-bd03f1272068 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 404 len: 111 microversion: 2.1 time: 0.033203 Aug 23 22:33:54.032032 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 681/1009] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:53 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:33:54.138220 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-287383904", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-861876496", "security_groups": [{"name": "tempest-secgroup-smoke-297031976"}], "block_device_mapping_v2": [{"uuid": "2462d48a-408f-489b-975c-b24b6536a23b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd15f43b-dcfe-4caf-8228-7089e7287c38"}]}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:54.313776 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] validate_networks() for [('dd15f43b-dcfe-4caf-8228-7089e7287c38', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:33:55.092190 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:33:55.093881 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:33:55.094367 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:33:55.094781 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:33:55.095492 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:33:55.106782 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:55.107930 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:55.108616 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:55.109890 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:55.110307 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:55.111208 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:55.137049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Getting quotas for project 77cc91a5c0bc4e5888460d7618594895. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:33:55.143301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Getting quotas for user fa949e48248747369eefd74280441b75 and project 77cc91a5c0bc4e5888460d7618594895. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:33:55.219096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:33:55.221303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2462d48a-408f-489b-975c-b24b6536a23b',volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:33:55.427275 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b3c0b70d-2da9-4089-a7fa-9e0a7d6e2fe1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.293108 Aug 23 22:33:55.439199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 682/1010] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:33:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:33:55.439199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-75c10970-9cd4-417b-84d4-fd77f3bfacf2 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:55.439199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-75c10970-9cd4-417b-84d4-fd77f3bfacf2 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:55.447702 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-75c10970-9cd4-417b-84d4-fd77f3bfacf2 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:55.448296 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-75c10970-9cd4-417b-84d4-fd77f3bfacf2 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:55.448657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-75c10970-9cd4-417b-84d4-fd77f3bfacf2 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:55.450445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-75c10970-9cd4-417b-84d4-fd77f3bfacf2 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:55.451056 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-75c10970-9cd4-417b-84d4-fd77f3bfacf2 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:55.451550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-75c10970-9cd4-417b-84d4-fd77f3bfacf2 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:55.710960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-75c10970-9cd4-417b-84d4-fd77f3bfacf2 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:55.723551 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-75c10970-9cd4-417b-84d4-fd77f3bfacf2 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1314 microversion: 2.1 time: 0.288834 Aug 23 22:33:55.724425 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 683/1011] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:55 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:55.732070 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8ab6a0fc-a34a-418a-9b0d-15c01e817d82 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:55.733319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8ab6a0fc-a34a-418a-9b0d-15c01e817d82 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:55.826342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8ab6a0fc-a34a-418a-9b0d-15c01e817d82 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:55.844333 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8ab6a0fc-a34a-418a-9b0d-15c01e817d82 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1093 microversion: 2.1 time: 0.117818 Aug 23 22:33:55.848293 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 684/1012] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:55 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1093 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:56.775359 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-78d6bff5-49e0-423e-a9b9-f03dcf47ebdd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:56.778047 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-78d6bff5-49e0-423e-a9b9-f03dcf47ebdd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:56.791423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78d6bff5-49e0-423e-a9b9-f03dcf47ebdd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:56.792769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78d6bff5-49e0-423e-a9b9-f03dcf47ebdd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:56.796278 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78d6bff5-49e0-423e-a9b9-f03dcf47ebdd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:56.798672 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78d6bff5-49e0-423e-a9b9-f03dcf47ebdd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:56.800686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78d6bff5-49e0-423e-a9b9-f03dcf47ebdd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:56.802402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-78d6bff5-49e0-423e-a9b9-f03dcf47ebdd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:57.118227 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-78d6bff5-49e0-423e-a9b9-f03dcf47ebdd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:57.140002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-78d6bff5-49e0-423e-a9b9-f03dcf47ebdd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1314 microversion: 2.1 time: 0.380941 Aug 23 22:33:57.140608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 685/1013] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:56 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:57.150089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c19d24d3-f50c-47e6-86d1-74da952909be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:57.153641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c19d24d3-f50c-47e6-86d1-74da952909be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:57.176108 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c19d24d3-f50c-47e6-86d1-74da952909be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:57.176605 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c19d24d3-f50c-47e6-86d1-74da952909be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:57.178076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c19d24d3-f50c-47e6-86d1-74da952909be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:57.178076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c19d24d3-f50c-47e6-86d1-74da952909be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:57.181379 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c19d24d3-f50c-47e6-86d1-74da952909be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:57.183754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c19d24d3-f50c-47e6-86d1-74da952909be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:57.349392 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c19d24d3-f50c-47e6-86d1-74da952909be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:57.360656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c19d24d3-f50c-47e6-86d1-74da952909be tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1199 microversion: 2.1 time: 0.218634 Aug 23 22:33:57.362592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 686/1014] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:57 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1199 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:57.368615 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-9ed6ff7c-2e26-44e6-a0a4-fab3f6a01e9c req-431836c4-0ba5-460e-8b4d-d4c78a146f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71551bd-6514-4992-9657-e3a11817a45d", "tag": "c32b9cab-1f46-4517-9391-483415677f0e"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:33:57.388801 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9ed6ff7c-2e26-44e6-a0a4-fab3f6a01e9c req-431836c4-0ba5-460e-8b4d-d4c78a146f49 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:57.393750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9ed6ff7c-2e26-44e6-a0a4-fab3f6a01e9c req-431836c4-0ba5-460e-8b4d-d4c78a146f49 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:57.394772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9ed6ff7c-2e26-44e6-a0a4-fab3f6a01e9c req-431836c4-0ba5-460e-8b4d-d4c78a146f49 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:57.426082 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-9ed6ff7c-2e26-44e6-a0a4-fab3f6a01e9c req-431836c4-0ba5-460e-8b4d-d4c78a146f49 service nova] Creating event network-changed:c32b9cab-1f46-4517-9391-483415677f0e for instance e71551bd-6514-4992-9657-e3a11817a45d on hv-cinder-85032 Aug 23 22:33:57.433002 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-9ed6ff7c-2e26-44e6-a0a4-fab3f6a01e9c req-431836c4-0ba5-460e-8b4d-d4c78a146f49 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068702 Aug 23 22:33:57.433673 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 687/1015] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:33:58.183205 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8865db4a-f6a6-4130-8429-f78ade39e353 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:58.183921 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8865db4a-f6a6-4130-8429-f78ade39e353 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:58.192338 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8865db4a-f6a6-4130-8429-f78ade39e353 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:58.192834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8865db4a-f6a6-4130-8429-f78ade39e353 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:58.193333 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8865db4a-f6a6-4130-8429-f78ade39e353 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:58.194069 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8865db4a-f6a6-4130-8429-f78ade39e353 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:58.194528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8865db4a-f6a6-4130-8429-f78ade39e353 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:58.194979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8865db4a-f6a6-4130-8429-f78ade39e353 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:58.413190 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8865db4a-f6a6-4130-8429-f78ade39e353 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:58.422854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8865db4a-f6a6-4130-8429-f78ade39e353 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1314 microversion: 2.1 time: 0.244911 Aug 23 22:33:58.423445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 688/1016] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:58 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:33:58.431999 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-883eed42-a801-4229-baa2-03e450c33e7a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:58.433096 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-883eed42-a801-4229-baa2-03e450c33e7a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:58.445025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-883eed42-a801-4229-baa2-03e450c33e7a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:58.445686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-883eed42-a801-4229-baa2-03e450c33e7a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:58.446218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-883eed42-a801-4229-baa2-03e450c33e7a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:58.447095 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-883eed42-a801-4229-baa2-03e450c33e7a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:58.447684 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-883eed42-a801-4229-baa2-03e450c33e7a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:58.448275 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-883eed42-a801-4229-baa2-03e450c33e7a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:58.454122 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:58.623278 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-883eed42-a801-4229-baa2-03e450c33e7a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:58.637766 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-883eed42-a801-4229-baa2-03e450c33e7a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1276 microversion: 2.1 time: 0.212236 Aug 23 22:33:58.638863 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 689/1017] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:58 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:59.447710 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fa6b227e-caaa-4f38-abc4-2e3690f4c132 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:59.448426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fa6b227e-caaa-4f38-abc4-2e3690f4c132 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:59.455964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa6b227e-caaa-4f38-abc4-2e3690f4c132 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:59.457423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa6b227e-caaa-4f38-abc4-2e3690f4c132 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:59.458331 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa6b227e-caaa-4f38-abc4-2e3690f4c132 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:59.460352 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa6b227e-caaa-4f38-abc4-2e3690f4c132 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:59.461433 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa6b227e-caaa-4f38-abc4-2e3690f4c132 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:59.461968 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fa6b227e-caaa-4f38-abc4-2e3690f4c132 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:59.660495 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fa6b227e-caaa-4f38-abc4-2e3690f4c132 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:59.669659 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fa6b227e-caaa-4f38-abc4-2e3690f4c132 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1314 microversion: 2.1 time: 0.225219 Aug 23 22:33:59.670416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 690/1018] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:59 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:33:59.675707 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cbee6a2c-dd09-463b-aa5e-202eb1385cc8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:33:59.676305 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cbee6a2c-dd09-463b-aa5e-202eb1385cc8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:33:59.682636 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cbee6a2c-dd09-463b-aa5e-202eb1385cc8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:59.683122 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cbee6a2c-dd09-463b-aa5e-202eb1385cc8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:59.683565 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cbee6a2c-dd09-463b-aa5e-202eb1385cc8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:59.685517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cbee6a2c-dd09-463b-aa5e-202eb1385cc8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:33:59.686019 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cbee6a2c-dd09-463b-aa5e-202eb1385cc8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:33:59.686481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cbee6a2c-dd09-463b-aa5e-202eb1385cc8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:33:59.878104 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-cbee6a2c-dd09-463b-aa5e-202eb1385cc8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:33:59.886692 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cbee6a2c-dd09-463b-aa5e-202eb1385cc8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1276 microversion: 2.1 time: 0.215189 Aug 23 22:33:59.887469 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 691/1019] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:33:59 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:00.703581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-70c260d0-4ba2-42a7-beb1-26be420e301c tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:00.704357 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-70c260d0-4ba2-42a7-beb1-26be420e301c tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:00.711391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70c260d0-4ba2-42a7-beb1-26be420e301c tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.711876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70c260d0-4ba2-42a7-beb1-26be420e301c tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.712306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70c260d0-4ba2-42a7-beb1-26be420e301c tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:00.713021 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70c260d0-4ba2-42a7-beb1-26be420e301c tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.713513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70c260d0-4ba2-42a7-beb1-26be420e301c tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.713938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-70c260d0-4ba2-42a7-beb1-26be420e301c tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:00.908835 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-70c260d0-4ba2-42a7-beb1-26be420e301c tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:00.921609 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-70c260d0-4ba2-42a7-beb1-26be420e301c tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1314 microversion: 2.1 time: 0.222098 Aug 23 22:34:00.922327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 692/1020] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:00 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:00.927558 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4f2d0cb2-774f-4b33-a3ba-fe15559f51d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:00.928309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4f2d0cb2-774f-4b33-a3ba-fe15559f51d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:00.939423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f2d0cb2-774f-4b33-a3ba-fe15559f51d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.940395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f2d0cb2-774f-4b33-a3ba-fe15559f51d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.941241 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f2d0cb2-774f-4b33-a3ba-fe15559f51d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:00.942615 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f2d0cb2-774f-4b33-a3ba-fe15559f51d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:00.943836 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f2d0cb2-774f-4b33-a3ba-fe15559f51d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:00.944278 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4f2d0cb2-774f-4b33-a3ba-fe15559f51d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:01.116573 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4f2d0cb2-774f-4b33-a3ba-fe15559f51d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:01.131467 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4f2d0cb2-774f-4b33-a3ba-fe15559f51d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1276 microversion: 2.1 time: 0.207605 Aug 23 22:34:01.132986 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 693/1021] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:00 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:01.974063 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0c771171-1be9-4b9a-9668-f3b42cce720f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:01.977692 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0c771171-1be9-4b9a-9668-f3b42cce720f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:02.004717 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c771171-1be9-4b9a-9668-f3b42cce720f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:02.013829 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c771171-1be9-4b9a-9668-f3b42cce720f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:02.015503 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c771171-1be9-4b9a-9668-f3b42cce720f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:02.017235 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c771171-1be9-4b9a-9668-f3b42cce720f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:02.018294 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c771171-1be9-4b9a-9668-f3b42cce720f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:02.019006 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0c771171-1be9-4b9a-9668-f3b42cce720f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:02.307767 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0c771171-1be9-4b9a-9668-f3b42cce720f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:02.319820 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0c771171-1be9-4b9a-9668-f3b42cce720f tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1314 microversion: 2.1 time: 0.363429 Aug 23 22:34:02.320510 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 694/1022] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:01 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:02.329616 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f0bb23d6-cd7c-4be7-9315-d4add63436e1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:02.331108 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f0bb23d6-cd7c-4be7-9315-d4add63436e1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:02.341294 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0bb23d6-cd7c-4be7-9315-d4add63436e1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:02.342205 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0bb23d6-cd7c-4be7-9315-d4add63436e1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:02.343063 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0bb23d6-cd7c-4be7-9315-d4add63436e1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:02.344724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0bb23d6-cd7c-4be7-9315-d4add63436e1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:02.345909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0bb23d6-cd7c-4be7-9315-d4add63436e1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:02.346954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f0bb23d6-cd7c-4be7-9315-d4add63436e1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:02.592342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f0bb23d6-cd7c-4be7-9315-d4add63436e1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:02.605431 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f0bb23d6-cd7c-4be7-9315-d4add63436e1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.283049 Aug 23 22:34:02.606880 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 695/1023] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:02 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:02.615845 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-1e917413-ef45-42b2-a335-09e8a2b78b55 req-1f97d5cd-450f-48b7-b675-481a3e3d525d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195eae82-7b86-4fc2-933b-1f5878f63036", "tag": "052e7b11-c246-43df-be23-a986bf10bdd8"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:02.633380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1e917413-ef45-42b2-a335-09e8a2b78b55 req-1f97d5cd-450f-48b7-b675-481a3e3d525d service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:02.634261 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1e917413-ef45-42b2-a335-09e8a2b78b55 req-1f97d5cd-450f-48b7-b675-481a3e3d525d service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:02.635447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1e917413-ef45-42b2-a335-09e8a2b78b55 req-1f97d5cd-450f-48b7-b675-481a3e3d525d service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:02.659058 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-1e917413-ef45-42b2-a335-09e8a2b78b55 req-1f97d5cd-450f-48b7-b675-481a3e3d525d service nova] Creating event network-changed:052e7b11-c246-43df-be23-a986bf10bdd8 for instance 195eae82-7b86-4fc2-933b-1f5878f63036 on hv-cinder-85032 Aug 23 22:34:02.667775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-1e917413-ef45-42b2-a335-09e8a2b78b55 req-1f97d5cd-450f-48b7-b675-481a3e3d525d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058725 Aug 23 22:34:02.669015 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 696/1024] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:03.365665 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-16bca1c9-1f8d-4da3-bab2-4df969af4306 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:03.366957 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-16bca1c9-1f8d-4da3-bab2-4df969af4306 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:03.377721 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16bca1c9-1f8d-4da3-bab2-4df969af4306 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:03.378326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16bca1c9-1f8d-4da3-bab2-4df969af4306 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:03.378762 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16bca1c9-1f8d-4da3-bab2-4df969af4306 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:03.380017 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16bca1c9-1f8d-4da3-bab2-4df969af4306 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:03.380595 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16bca1c9-1f8d-4da3-bab2-4df969af4306 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:03.380994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-16bca1c9-1f8d-4da3-bab2-4df969af4306 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:03.616956 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-16bca1c9-1f8d-4da3-bab2-4df969af4306 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:03.636313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-16bca1c9-1f8d-4da3-bab2-4df969af4306 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1314 microversion: 2.1 time: 0.279716 Aug 23 22:34:03.638310 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 697/1025] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:03 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:03.648656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-c5aaad8d-446e-4c0c-83fe-a11fa7ead06c req-22db40e0-4ece-415a-8f15-1cccc2492631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71551bd-6514-4992-9657-e3a11817a45d", "name": "network-vif-plugged", "status": "completed", "tag": "c32b9cab-1f46-4517-9391-483415677f0e"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:03.661111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:03.670371 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-c5aaad8d-446e-4c0c-83fe-a11fa7ead06c req-22db40e0-4ece-415a-8f15-1cccc2492631 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:03.671306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-c5aaad8d-446e-4c0c-83fe-a11fa7ead06c req-22db40e0-4ece-415a-8f15-1cccc2492631 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:03.672121 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-c5aaad8d-446e-4c0c-83fe-a11fa7ead06c req-22db40e0-4ece-415a-8f15-1cccc2492631 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:03.696927 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-c5aaad8d-446e-4c0c-83fe-a11fa7ead06c req-22db40e0-4ece-415a-8f15-1cccc2492631 service nova] Creating event network-vif-plugged:c32b9cab-1f46-4517-9391-483415677f0e for instance e71551bd-6514-4992-9657-e3a11817a45d on hv-cinder-85032 Aug 23 22:34:03.706380 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-c5aaad8d-446e-4c0c-83fe-a11fa7ead06c req-22db40e0-4ece-415a-8f15-1cccc2492631 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065578 Aug 23 22:34:03.707302 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 698/1026] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:03.715248 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-33da5d70-ad2e-4787-ad17-71ab59befe4b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:03.717118 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-33da5d70-ad2e-4787-ad17-71ab59befe4b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:03.729649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-33da5d70-ad2e-4787-ad17-71ab59befe4b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:03.730458 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-33da5d70-ad2e-4787-ad17-71ab59befe4b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:03.731417 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-33da5d70-ad2e-4787-ad17-71ab59befe4b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:03.732746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-33da5d70-ad2e-4787-ad17-71ab59befe4b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:03.733625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-33da5d70-ad2e-4787-ad17-71ab59befe4b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:03.734405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-33da5d70-ad2e-4787-ad17-71ab59befe4b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:03.952887 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-33da5d70-ad2e-4787-ad17-71ab59befe4b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:03.963360 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-33da5d70-ad2e-4787-ad17-71ab59befe4b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.254156 Aug 23 22:34:03.963970 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 699/1027] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:03 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:04.672546 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-8f815a47-9130-48cd-9544-a19bc1179fa8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:04.673914 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-8f815a47-9130-48cd-9544-a19bc1179fa8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:04.682787 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f815a47-9130-48cd-9544-a19bc1179fa8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:04.683347 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f815a47-9130-48cd-9544-a19bc1179fa8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:04.683841 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f815a47-9130-48cd-9544-a19bc1179fa8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:04.685306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f815a47-9130-48cd-9544-a19bc1179fa8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:04.685853 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f815a47-9130-48cd-9544-a19bc1179fa8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:04.686554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-8f815a47-9130-48cd-9544-a19bc1179fa8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:04.928703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-8f815a47-9130-48cd-9544-a19bc1179fa8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:04.939225 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-8f815a47-9130-48cd-9544-a19bc1179fa8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1314 microversion: 2.1 time: 0.273886 Aug 23 22:34:04.940119 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 700/1028] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:04 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:04.986365 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-581d2579-85bc-4671-a414-cda16ea50a16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:04.987065 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-581d2579-85bc-4671-a414-cda16ea50a16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:04.993987 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-581d2579-85bc-4671-a414-cda16ea50a16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:04.994488 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-581d2579-85bc-4671-a414-cda16ea50a16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:04.994928 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-581d2579-85bc-4671-a414-cda16ea50a16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:04.995761 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-581d2579-85bc-4671-a414-cda16ea50a16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:04.996139 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-581d2579-85bc-4671-a414-cda16ea50a16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:04.996613 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-581d2579-85bc-4671-a414-cda16ea50a16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:05.119858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:05.192294 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-581d2579-85bc-4671-a414-cda16ea50a16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:05.207644 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-581d2579-85bc-4671-a414-cda16ea50a16 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.225150 Aug 23 22:34:05.208736 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 701/1029] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:04 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:05.973600 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-26dffdc1-50f2-4635-97bb-78f048077787 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:05.974426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-26dffdc1-50f2-4635-97bb-78f048077787 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:05.976614 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=16 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:05.983949 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-26dffdc1-50f2-4635-97bb-78f048077787 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:05.984563 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-26dffdc1-50f2-4635-97bb-78f048077787 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:05.985046 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-26dffdc1-50f2-4635-97bb-78f048077787 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:05.985991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-26dffdc1-50f2-4635-97bb-78f048077787 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:05.986682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-26dffdc1-50f2-4635-97bb-78f048077787 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:05.987124 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-26dffdc1-50f2-4635-97bb-78f048077787 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:06.179381 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-26dffdc1-50f2-4635-97bb-78f048077787 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:06.190430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-26dffdc1-50f2-4635-97bb-78f048077787 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1314 microversion: 2.1 time: 0.220834 Aug 23 22:34:06.204268 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 702/1030] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:05 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:06.236222 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5ea83f1d-28d6-432b-bace-c1e3ab356b3a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:06.238210 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5ea83f1d-28d6-432b-bace-c1e3ab356b3a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:06.251758 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ea83f1d-28d6-432b-bace-c1e3ab356b3a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:06.252536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ea83f1d-28d6-432b-bace-c1e3ab356b3a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:06.253313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ea83f1d-28d6-432b-bace-c1e3ab356b3a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:06.254650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ea83f1d-28d6-432b-bace-c1e3ab356b3a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:06.255509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ea83f1d-28d6-432b-bace-c1e3ab356b3a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:06.256586 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5ea83f1d-28d6-432b-bace-c1e3ab356b3a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:06.589592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5ea83f1d-28d6-432b-bace-c1e3ab356b3a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:06.600741 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5ea83f1d-28d6-432b-bace-c1e3ab356b3a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.373692 Aug 23 22:34:06.601559 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 703/1031] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:06 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:07.215127 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-4c5216da-406a-4481-bd05-36e27ec02e9e tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:07.216032 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-4c5216da-406a-4481-bd05-36e27ec02e9e tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:07.225984 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c5216da-406a-4481-bd05-36e27ec02e9e tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:07.226821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c5216da-406a-4481-bd05-36e27ec02e9e tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:07.227575 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c5216da-406a-4481-bd05-36e27ec02e9e tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:07.228800 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c5216da-406a-4481-bd05-36e27ec02e9e tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:07.229630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c5216da-406a-4481-bd05-36e27ec02e9e tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:07.230403 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-4c5216da-406a-4481-bd05-36e27ec02e9e tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:07.434896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-4c5216da-406a-4481-bd05-36e27ec02e9e tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:07.443969 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-4c5216da-406a-4481-bd05-36e27ec02e9e tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1314 microversion: 2.1 time: 0.232799 Aug 23 22:34:07.444642 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 704/1032] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:07 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:07.636671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f689a7e4-f5a9-4f4a-b010-e1c670d45cb5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:07.637479 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f689a7e4-f5a9-4f4a-b010-e1c670d45cb5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:07.644667 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f689a7e4-f5a9-4f4a-b010-e1c670d45cb5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:07.645181 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f689a7e4-f5a9-4f4a-b010-e1c670d45cb5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:07.645692 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f689a7e4-f5a9-4f4a-b010-e1c670d45cb5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:07.646418 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f689a7e4-f5a9-4f4a-b010-e1c670d45cb5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:07.646876 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f689a7e4-f5a9-4f4a-b010-e1c670d45cb5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:07.647304 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f689a7e4-f5a9-4f4a-b010-e1c670d45cb5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:07.860416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f689a7e4-f5a9-4f4a-b010-e1c670d45cb5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:07.875695 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f689a7e4-f5a9-4f4a-b010-e1c670d45cb5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.243712 Aug 23 22:34:07.877275 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 705/1033] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:07 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:08.471728 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-99f92b64-8e7b-494e-a236-eaa27101b78b tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:08.472784 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-99f92b64-8e7b-494e-a236-eaa27101b78b tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:08.484775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99f92b64-8e7b-494e-a236-eaa27101b78b tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:08.485750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99f92b64-8e7b-494e-a236-eaa27101b78b tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:08.486431 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99f92b64-8e7b-494e-a236-eaa27101b78b tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:08.487650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99f92b64-8e7b-494e-a236-eaa27101b78b tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:08.488221 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99f92b64-8e7b-494e-a236-eaa27101b78b tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:08.488838 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99f92b64-8e7b-494e-a236-eaa27101b78b tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:08.653495 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-99f92b64-8e7b-494e-a236-eaa27101b78b tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:08.662884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-99f92b64-8e7b-494e-a236-eaa27101b78b tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1464 microversion: 2.1 time: 0.199035 Aug 23 22:34:08.663768 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 706/1034] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:08 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1464 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:08.723207 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c16cab8f-cef0-4063-8a73-1d8e5cf6f77a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:08.724031 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c16cab8f-cef0-4063-8a73-1d8e5cf6f77a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:08.735183 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c16cab8f-cef0-4063-8a73-1d8e5cf6f77a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:08.735892 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c16cab8f-cef0-4063-8a73-1d8e5cf6f77a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:08.736554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c16cab8f-cef0-4063-8a73-1d8e5cf6f77a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:08.738029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c16cab8f-cef0-4063-8a73-1d8e5cf6f77a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:08.738858 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c16cab8f-cef0-4063-8a73-1d8e5cf6f77a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:08.739608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c16cab8f-cef0-4063-8a73-1d8e5cf6f77a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:08.749114 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=100 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:08.799365 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c16cab8f-cef0-4063-8a73-1d8e5cf6f77a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:34:08.932013 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c16cab8f-cef0-4063-8a73-1d8e5cf6f77a tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 204 len: 0 microversion: 2.1 time: 0.216337 Aug 23 22:34:08.932732 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 707/1035] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:34:08 2022] DELETE /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:34:08.940167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ec31c13b-1114-42e0-bad5-e7631fbfc87c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:08.940768 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ec31c13b-1114-42e0-bad5-e7631fbfc87c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:08.947327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ec31c13b-1114-42e0-bad5-e7631fbfc87c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:08.947814 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ec31c13b-1114-42e0-bad5-e7631fbfc87c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:08.948286 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ec31c13b-1114-42e0-bad5-e7631fbfc87c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:08.948976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ec31c13b-1114-42e0-bad5-e7631fbfc87c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:08.950028 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ec31c13b-1114-42e0-bad5-e7631fbfc87c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:08.950475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ec31c13b-1114-42e0-bad5-e7631fbfc87c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:09.134475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ec31c13b-1114-42e0-bad5-e7631fbfc87c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:09.143810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ec31c13b-1114-42e0-bad5-e7631fbfc87c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.209749 Aug 23 22:34:09.144420 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 708/1036] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:08 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:09.149399 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a5eb42b7-8243-4f82-94f3-2f8b624cad99 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:09.150112 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a5eb42b7-8243-4f82-94f3-2f8b624cad99 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:09.160998 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5eb42b7-8243-4f82-94f3-2f8b624cad99 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:09.162593 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5eb42b7-8243-4f82-94f3-2f8b624cad99 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:09.163419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5eb42b7-8243-4f82-94f3-2f8b624cad99 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:09.164724 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5eb42b7-8243-4f82-94f3-2f8b624cad99 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:09.165598 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5eb42b7-8243-4f82-94f3-2f8b624cad99 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:09.166381 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a5eb42b7-8243-4f82-94f3-2f8b624cad99 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:09.357960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a5eb42b7-8243-4f82-94f3-2f8b624cad99 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:09.366905 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a5eb42b7-8243-4f82-94f3-2f8b624cad99 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1470 microversion: 2.1 time: 0.221371 Aug 23 22:34:09.367501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 709/1037] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:09 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:10.189517 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ead01d50-10a9-4f86-bce8-6656c06684c1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:10.190514 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ead01d50-10a9-4f86-bce8-6656c06684c1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:10.196870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ead01d50-10a9-4f86-bce8-6656c06684c1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:10.197389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ead01d50-10a9-4f86-bce8-6656c06684c1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:10.197821 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ead01d50-10a9-4f86-bce8-6656c06684c1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:10.198743 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ead01d50-10a9-4f86-bce8-6656c06684c1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:10.199202 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ead01d50-10a9-4f86-bce8-6656c06684c1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:10.199689 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ead01d50-10a9-4f86-bce8-6656c06684c1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:10.367203 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-ead01d50-10a9-4f86-bce8-6656c06684c1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:10.383149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ead01d50-10a9-4f86-bce8-6656c06684c1 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.202395 Aug 23 22:34:10.384294 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 710/1038] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:10 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:10.390733 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-09aadcae-5f65-43cd-8e8e-f193ae5fa7bd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:10.391350 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-09aadcae-5f65-43cd-8e8e-f193ae5fa7bd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:10.399362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-09aadcae-5f65-43cd-8e8e-f193ae5fa7bd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:10.399901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-09aadcae-5f65-43cd-8e8e-f193ae5fa7bd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:10.400313 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-09aadcae-5f65-43cd-8e8e-f193ae5fa7bd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:10.401111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-09aadcae-5f65-43cd-8e8e-f193ae5fa7bd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:10.401626 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-09aadcae-5f65-43cd-8e8e-f193ae5fa7bd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:10.402135 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-09aadcae-5f65-43cd-8e8e-f193ae5fa7bd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:10.588548 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-09aadcae-5f65-43cd-8e8e-f193ae5fa7bd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:10.603608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-09aadcae-5f65-43cd-8e8e-f193ae5fa7bd tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1470 microversion: 2.1 time: 0.216280 Aug 23 22:34:10.604476 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 711/1039] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:10 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:11.420933 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1c30af68-ba75-43b6-a854-153f13e331d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:11.422387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1c30af68-ba75-43b6-a854-153f13e331d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:11.435698 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c30af68-ba75-43b6-a854-153f13e331d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:11.436536 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c30af68-ba75-43b6-a854-153f13e331d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:11.437513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c30af68-ba75-43b6-a854-153f13e331d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:11.438885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c30af68-ba75-43b6-a854-153f13e331d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:11.439703 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c30af68-ba75-43b6-a854-153f13e331d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:11.440512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c30af68-ba75-43b6-a854-153f13e331d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:11.623490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1c30af68-ba75-43b6-a854-153f13e331d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:11.639915 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1c30af68-ba75-43b6-a854-153f13e331d7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.225980 Aug 23 22:34:11.641022 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 712/1040] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:11 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:11.650078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9df3da0d-815c-4bd0-8684-43f46f557fb8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:11.651264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9df3da0d-815c-4bd0-8684-43f46f557fb8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:11.664402 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df3da0d-815c-4bd0-8684-43f46f557fb8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:11.665884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df3da0d-815c-4bd0-8684-43f46f557fb8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:11.666685 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df3da0d-815c-4bd0-8684-43f46f557fb8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:11.667852 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df3da0d-815c-4bd0-8684-43f46f557fb8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:11.669614 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df3da0d-815c-4bd0-8684-43f46f557fb8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:11.670259 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9df3da0d-815c-4bd0-8684-43f46f557fb8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:11.854955 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9df3da0d-815c-4bd0-8684-43f46f557fb8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:11.863499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9df3da0d-815c-4bd0-8684-43f46f557fb8 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1470 microversion: 2.1 time: 0.220937 Aug 23 22:34:11.864089 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 713/1041] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:11 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:12.676359 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e9fe9586-0670-4b99-b6d4-9f8245303649 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:12.677494 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e9fe9586-0670-4b99-b6d4-9f8245303649 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:12.688940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9fe9586-0670-4b99-b6d4-9f8245303649 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:12.689809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9fe9586-0670-4b99-b6d4-9f8245303649 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:12.690741 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9fe9586-0670-4b99-b6d4-9f8245303649 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:12.692110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9fe9586-0670-4b99-b6d4-9f8245303649 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:12.692886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9fe9586-0670-4b99-b6d4-9f8245303649 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:12.693657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9fe9586-0670-4b99-b6d4-9f8245303649 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:12.938587 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e9fe9586-0670-4b99-b6d4-9f8245303649 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:12.948839 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e9fe9586-0670-4b99-b6d4-9f8245303649 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.276663 Aug 23 22:34:12.950518 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 714/1042] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:12 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:12.957194 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6332ccb8-e0c0-4ddd-a7ee-cc60fc41d2c3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:12.958107 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6332ccb8-e0c0-4ddd-a7ee-cc60fc41d2c3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:12.970506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6332ccb8-e0c0-4ddd-a7ee-cc60fc41d2c3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:12.971197 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6332ccb8-e0c0-4ddd-a7ee-cc60fc41d2c3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:12.971830 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6332ccb8-e0c0-4ddd-a7ee-cc60fc41d2c3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:12.972764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6332ccb8-e0c0-4ddd-a7ee-cc60fc41d2c3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:12.973550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6332ccb8-e0c0-4ddd-a7ee-cc60fc41d2c3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:12.974208 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6332ccb8-e0c0-4ddd-a7ee-cc60fc41d2c3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:13.205528 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6332ccb8-e0c0-4ddd-a7ee-cc60fc41d2c3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:13.217450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6332ccb8-e0c0-4ddd-a7ee-cc60fc41d2c3 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1470 microversion: 2.1 time: 0.265142 Aug 23 22:34:13.233016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 715/1043] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:12 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:13.991299 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5be8f0b2-3b8b-4f08-85d5-effd4c4131dd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:13.993991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5be8f0b2-3b8b-4f08-85d5-effd4c4131dd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:14.016914 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5be8f0b2-3b8b-4f08-85d5-effd4c4131dd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:14.018137 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5be8f0b2-3b8b-4f08-85d5-effd4c4131dd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:14.019453 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5be8f0b2-3b8b-4f08-85d5-effd4c4131dd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:14.021336 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5be8f0b2-3b8b-4f08-85d5-effd4c4131dd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:14.023260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5be8f0b2-3b8b-4f08-85d5-effd4c4131dd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:14.023886 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5be8f0b2-3b8b-4f08-85d5-effd4c4131dd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:14.331207 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5be8f0b2-3b8b-4f08-85d5-effd4c4131dd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:14.341181 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5be8f0b2-3b8b-4f08-85d5-effd4c4131dd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.364973 Aug 23 22:34:14.342588 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 716/1044] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:13 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:14.347718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-1f3c1a03-1c15-476c-b7fb-4e2aed8c5e8a req-3937bc05-8b9e-4138-8323-026f627a2a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71551bd-6514-4992-9657-e3a11817a45d", "name": "network-vif-deleted", "tag": "c32b9cab-1f46-4517-9391-483415677f0e"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:14.359492 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1f3c1a03-1c15-476c-b7fb-4e2aed8c5e8a req-3937bc05-8b9e-4138-8323-026f627a2a32 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:14.359973 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1f3c1a03-1c15-476c-b7fb-4e2aed8c5e8a req-3937bc05-8b9e-4138-8323-026f627a2a32 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:14.360668 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1f3c1a03-1c15-476c-b7fb-4e2aed8c5e8a req-3937bc05-8b9e-4138-8323-026f627a2a32 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:14.375261 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-1f3c1a03-1c15-476c-b7fb-4e2aed8c5e8a req-3937bc05-8b9e-4138-8323-026f627a2a32 service nova] Creating event network-vif-deleted:c32b9cab-1f46-4517-9391-483415677f0e for instance e71551bd-6514-4992-9657-e3a11817a45d on hv-cinder-85032 Aug 23 22:34:14.381378 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-1f3c1a03-1c15-476c-b7fb-4e2aed8c5e8a req-3937bc05-8b9e-4138-8323-026f627a2a32 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036859 Aug 23 22:34:14.382075 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 717/1045] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:14.388342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:14.389044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:14.396447 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:14.397167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:14.397802 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:14.398947 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:14.399657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:14.400562 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:14.438850 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:14.439534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:14.439979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:14.440461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lazy-loading 'fault' on Instance uuid e71551bd-6514-4992-9657-e3a11817a45d {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:34:14.507214 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '086e60f669894290be19bd9b4b40d1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07e102f326541e2a89cfe541aa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:14.516247 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6945141f-500c-4b7c-8ab2-1a5dcda13753 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 200 len: 1304 microversion: 2.1 time: 0.132615 Aug 23 22:34:14.516854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 718/1046] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:14 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:15.339039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-002301b5-0e67-4589-89d5-477e346abfee req-f703f217-7eba-4c9a-9e82-96ac402a5fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195eae82-7b86-4fc2-933b-1f5878f63036", "name": "network-vif-plugged", "status": "completed", "tag": "052e7b11-c246-43df-be23-a986bf10bdd8"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:15.363584 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-002301b5-0e67-4589-89d5-477e346abfee req-f703f217-7eba-4c9a-9e82-96ac402a5fb9 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:15.364725 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-002301b5-0e67-4589-89d5-477e346abfee req-f703f217-7eba-4c9a-9e82-96ac402a5fb9 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:15.365452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-002301b5-0e67-4589-89d5-477e346abfee req-f703f217-7eba-4c9a-9e82-96ac402a5fb9 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:15.385485 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-002301b5-0e67-4589-89d5-477e346abfee req-f703f217-7eba-4c9a-9e82-96ac402a5fb9 service nova] Creating event network-vif-plugged:052e7b11-c246-43df-be23-a986bf10bdd8 for instance 195eae82-7b86-4fc2-933b-1f5878f63036 on hv-cinder-85032 Aug 23 22:34:15.392138 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-002301b5-0e67-4589-89d5-477e346abfee req-f703f217-7eba-4c9a-9e82-96ac402a5fb9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059651 Aug 23 22:34:15.392872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 719/1047] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:34:15.400071 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c933d63a-8c0c-4ef2-b78c-53b2060ad171 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:15.401005 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c933d63a-8c0c-4ef2-b78c-53b2060ad171 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:15.410231 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c933d63a-8c0c-4ef2-b78c-53b2060ad171 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:15.410865 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c933d63a-8c0c-4ef2-b78c-53b2060ad171 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:15.411446 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c933d63a-8c0c-4ef2-b78c-53b2060ad171 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:15.412385 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c933d63a-8c0c-4ef2-b78c-53b2060ad171 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:15.412942 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c933d63a-8c0c-4ef2-b78c-53b2060ad171 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:15.413509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c933d63a-8c0c-4ef2-b78c-53b2060ad171 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:15.606866 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c933d63a-8c0c-4ef2-b78c-53b2060ad171 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:15.623452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c933d63a-8c0c-4ef2-b78c-53b2060ad171 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.228638 Aug 23 22:34:15.624385 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 720/1048] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:15 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:15.634029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:15.635109 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] [instance: e71551bd-6514-4992-9657-e3a11817a45d] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:15.659159 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:15.660142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:15.660945 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:15.662322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:15.663171 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:15.663945 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:15.692303 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] HTTP exception thrown: Instance e71551bd-6514-4992-9657-e3a11817a45d could not be found. Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Request method failure captured: Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d HTTP/1.1 Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVXJVRe2QYYd9fRqhK5wSqmZWeHo5ZgnSAJKQDrvnJX-kPHcY0uy1qWrLRW7s-N9E7RTPLX-EqEYJPSR5Q1WW6gtTOWPGIObMGIbDqt7UslGv1TUUeeTHTfwfjTgxYVWYZkVAsnM_s_w5SMWlzwMm35BtZr8i7GiM4gEVycYyn-Er-I Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: a07e102f326541e2a89cfe541aa7a022 Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-VolumesNegativeTest-1750422317 Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:34:15.695827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a07e102f326541e2a89cfe541aa7a022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a07e102f326541e2a89cfe541aa7a022"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a07e102f326541e2a89cfe541aa7a022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a07e102f326541e2a89cfe541aa7a022"}]}] Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-VolumesNegativeTest-1750422317 Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: a07e102f326541e2a89cfe541aa7a022 Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-VolumesNegativeTest-1750422317 Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-VolumesNegativeTest-1750422317-project Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 086e60f669894290be19bd9b4b40d1d5 Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-VolumesNegativeTest-1750422317-project Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance e71551bd-6514-4992-9657-e3a11817a45d could not be found. Aug 23 22:34:15.697461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'e71551bd-6514-4992-9657-e3a11817a45d'} Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71551bd-6514-4992-9657-e3a11817a45d could not be found. Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:34:15.698394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71551bd-6514-4992-9657-e3a11817a45d could not be found. Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71551bd-6514-4992-9657-e3a11817a45d could not be found. Aug 23 22:34:15.701025 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:34:15.703172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] Returning 404 to user: Instance e71551bd-6514-4992-9657-e3a11817a45d could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:34:15.703172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ab49d664-0eed-4b93-aa2b-d90df43867f0 tempest-VolumesNegativeTest-1750422317 tempest-VolumesNegativeTest-1750422317-project] 10.222.0.88 "GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d" status: 404 len: 111 microversion: 2.1 time: 0.072109 Aug 23 22:34:15.703172 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 721/1049] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:15 2022] GET /compute/v2.1/servers/e71551bd-6514-4992-9657-e3a11817a45d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:34:16.654630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-14f9999e-fe77-4771-a056-7c7b1a50c095 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:16.656917 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-14f9999e-fe77-4771-a056-7c7b1a50c095 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:16.670730 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14f9999e-fe77-4771-a056-7c7b1a50c095 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:16.671382 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14f9999e-fe77-4771-a056-7c7b1a50c095 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:16.671989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14f9999e-fe77-4771-a056-7c7b1a50c095 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:16.674153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14f9999e-fe77-4771-a056-7c7b1a50c095 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:16.674781 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14f9999e-fe77-4771-a056-7c7b1a50c095 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:16.675475 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-14f9999e-fe77-4771-a056-7c7b1a50c095 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:16.941877 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-14f9999e-fe77-4771-a056-7c7b1a50c095 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:16.952501 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-14f9999e-fe77-4771-a056-7c7b1a50c095 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1264 microversion: 2.1 time: 0.305505 Aug 23 22:34:16.968183 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 722/1050] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:16 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1264 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:17.980166 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-672a5c34-354a-43b0-9c76-684f056a1f4e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:17.981756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-672a5c34-354a-43b0-9c76-684f056a1f4e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:17.992425 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-672a5c34-354a-43b0-9c76-684f056a1f4e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:17.993230 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-672a5c34-354a-43b0-9c76-684f056a1f4e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:17.993966 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-672a5c34-354a-43b0-9c76-684f056a1f4e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:17.995131 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-672a5c34-354a-43b0-9c76-684f056a1f4e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:17.995823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-672a5c34-354a-43b0-9c76-684f056a1f4e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:17.997975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-672a5c34-354a-43b0-9c76-684f056a1f4e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:18.266754 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-672a5c34-354a-43b0-9c76-684f056a1f4e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:18.271980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:18.284200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-672a5c34-354a-43b0-9c76-684f056a1f4e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1450 microversion: 2.1 time: 0.310999 Aug 23 22:34:18.302834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 723/1051] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:17 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1450 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:34:18.316588 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-a81ecc94-ca40-4cba-8325-b3bb381f9260 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:34:18.318175 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-a81ecc94-ca40-4cba-8325-b3bb381f9260 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:34:18.329960 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a81ecc94-ca40-4cba-8325-b3bb381f9260 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:18.331007 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a81ecc94-ca40-4cba-8325-b3bb381f9260 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:18.331727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a81ecc94-ca40-4cba-8325-b3bb381f9260 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:18.333079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a81ecc94-ca40-4cba-8325-b3bb381f9260 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:18.333944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a81ecc94-ca40-4cba-8325-b3bb381f9260 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:18.334664 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-a81ecc94-ca40-4cba-8325-b3bb381f9260 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:18.955562 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-a81ecc94-ca40-4cba-8325-b3bb381f9260 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:34:18.970854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-a81ecc94-ca40-4cba-8325-b3bb381f9260 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1450 microversion: 2.1 time: 0.659474 Aug 23 22:34:18.971811 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 724/1052] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:34:18 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1450 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:34:21.565356 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-1b4ae925-91e1-44aa-b9a6-6eadc10b04ba req-8e2b1ee4-f29b-42b1-8858-f06baaeaa510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195eae82-7b86-4fc2-933b-1f5878f63036", "tag": "052e7b11-c246-43df-be23-a986bf10bdd8"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:21.577462 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1b4ae925-91e1-44aa-b9a6-6eadc10b04ba req-8e2b1ee4-f29b-42b1-8858-f06baaeaa510 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:34:21.577951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1b4ae925-91e1-44aa-b9a6-6eadc10b04ba req-8e2b1ee4-f29b-42b1-8858-f06baaeaa510 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:34:21.578377 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-1b4ae925-91e1-44aa-b9a6-6eadc10b04ba req-8e2b1ee4-f29b-42b1-8858-f06baaeaa510 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:34:21.593162 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-1b4ae925-91e1-44aa-b9a6-6eadc10b04ba req-8e2b1ee4-f29b-42b1-8858-f06baaeaa510 service nova] Creating event network-changed:052e7b11-c246-43df-be23-a986bf10bdd8 for instance 195eae82-7b86-4fc2-933b-1f5878f63036 on hv-cinder-85032 Aug 23 22:34:21.599939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-1b4ae925-91e1-44aa-b9a6-6eadc10b04ba req-8e2b1ee4-f29b-42b1-8858-f06baaeaa510 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037964 Aug 23 22:34:21.600649 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 725/1053] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:34:42.314825 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:42.315604 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=8 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:42.572834 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2c235f44-9b18-4f3f-ba78-2563ea1271c3 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Action: 'create', calling method: .version_select at 0x7f902d698940>, body: {"keypair": {"name": "tempest-TestShelveInstance-398648710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2UAhLb6sAPeJH3tNzi1UyffGPAAnwKxP/r0h+3W6AhTgNTWrwwmWsm7vhE/RPgsSrdqO8lI6KzFKaIRWY/Zw8gQtoVO1VCISYDCtMWJdIs9Y9X4nOPQvSsUeMVIyS98A=="}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:34:42.609322 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-2c235f44-9b18-4f3f-ba78-2563ea1271c3 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Getting quotas for project 94a56fcfc827430fb1b73dcfd186024d. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:34:42.618620 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-2c235f44-9b18-4f3f-ba78-2563ea1271c3 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Getting quotas for user 7a43d4ec9b1346e3a69b01d3d6e83a98 and project 94a56fcfc827430fb1b73dcfd186024d. Resources: {'key_pairs'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:34:42.674540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2c235f44-9b18-4f3f-ba78-2563ea1271c3 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.364322 Aug 23 22:34:42.676250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 726/1054] 10.222.0.88 () {60 vars in 1159 bytes} [Tue Aug 23 22:34:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:35:01.772738 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=4 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:01.775521 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:01.786158 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1117659211", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-398648710", "security_groups": [{"name": "tempest-secgroup-smoke-1406622647"}], "networks": [{"uuid": "0b2d0fbd-fe67-431e-96f5-8b6b0f6d0fcd"}], "block_device_mapping_v2": [{"uuid": "0cc42f78-bbdc-4136-ac86-6245e947533f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:35:02.310282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] validate_networks() for [('0b2d0fbd-fe67-431e-96f5-8b6b0f6d0fcd', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:35:02.899345 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:35:02.900522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:35:02.901264 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:35:02.902081 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:35:02.902893 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:35:02.920965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:02.921861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:02.922944 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:02.924394 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:02.925318 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:02.926087 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:02.962578 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Getting quotas for project 94a56fcfc827430fb1b73dcfd186024d. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:35:02.969827 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Getting quotas for user 7a43d4ec9b1346e3a69b01d3d6e83a98 and project 94a56fcfc827430fb1b73dcfd186024d. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:35:03.055375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:35:03.058980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0cc42f78-bbdc-4136-ac86-6245e947533f',volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:35:03.254222 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fadccd28-d79f-45c6-93a5-66bf30229e98 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.484836 Aug 23 22:35:03.255656 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 727/1055] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:35:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 22:35:03.269875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3d584790-3377-423e-a845-adb536991101 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:03.270506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3d584790-3377-423e-a845-adb536991101 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:03.346311 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3d584790-3377-423e-a845-adb536991101 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:03.355268 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3d584790-3377-423e-a845-adb536991101 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1088 microversion: 2.1 time: 0.089554 Aug 23 22:35:03.356438 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 728/1056] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:03 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1088 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:04.392841 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9ef17f82-658e-4b5c-a444-bc29743f0f2c tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:04.394176 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9ef17f82-658e-4b5c-a444-bc29743f0f2c tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:04.405100 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ef17f82-658e-4b5c-a444-bc29743f0f2c tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:04.405573 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ef17f82-658e-4b5c-a444-bc29743f0f2c tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:04.406039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ef17f82-658e-4b5c-a444-bc29743f0f2c tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:04.406746 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ef17f82-658e-4b5c-a444-bc29743f0f2c tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:04.407196 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ef17f82-658e-4b5c-a444-bc29743f0f2c tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:04.407621 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9ef17f82-658e-4b5c-a444-bc29743f0f2c tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:04.487362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9ef17f82-658e-4b5c-a444-bc29743f0f2c tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:04.498101 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9ef17f82-658e-4b5c-a444-bc29743f0f2c tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1186 microversion: 2.1 time: 0.110704 Aug 23 22:35:04.498772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 729/1057] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:04 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:05.530061 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c69fa90d-471b-492e-b7f9-97ffe1a83065 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:05.536637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c69fa90d-471b-492e-b7f9-97ffe1a83065 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:05.553534 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c69fa90d-471b-492e-b7f9-97ffe1a83065 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:05.554488 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c69fa90d-471b-492e-b7f9-97ffe1a83065 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:05.555168 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c69fa90d-471b-492e-b7f9-97ffe1a83065 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:05.556395 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c69fa90d-471b-492e-b7f9-97ffe1a83065 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:05.557308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c69fa90d-471b-492e-b7f9-97ffe1a83065 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:05.558325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c69fa90d-471b-492e-b7f9-97ffe1a83065 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:05.868277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c69fa90d-471b-492e-b7f9-97ffe1a83065 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:05.880177 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c69fa90d-471b-492e-b7f9-97ffe1a83065 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1272 microversion: 2.1 time: 0.362547 Aug 23 22:35:05.881039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 730/1058] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:05 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1272 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:06.561592 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-9b4dd7cd-1491-4598-8a70-bea70b5c1ca4 req-58a1d721-c64d-4404-ac9b-466a45b4ad9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b18b61-3c70-4ef9-b21e-8f34cae4d729", "tag": "7329ee58-549d-4382-bc19-ec3d07cd19db"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:35:06.572201 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9b4dd7cd-1491-4598-8a70-bea70b5c1ca4 req-58a1d721-c64d-4404-ac9b-466a45b4ad9a service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:06.573480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9b4dd7cd-1491-4598-8a70-bea70b5c1ca4 req-58a1d721-c64d-4404-ac9b-466a45b4ad9a service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:06.573976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-9b4dd7cd-1491-4598-8a70-bea70b5c1ca4 req-58a1d721-c64d-4404-ac9b-466a45b4ad9a service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:06.586496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-9b4dd7cd-1491-4598-8a70-bea70b5c1ca4 req-58a1d721-c64d-4404-ac9b-466a45b4ad9a service nova] Creating event network-changed:7329ee58-549d-4382-bc19-ec3d07cd19db for instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 on hv-cinder-85032 Aug 23 22:35:06.592639 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-9b4dd7cd-1491-4598-8a70-bea70b5c1ca4 req-58a1d721-c64d-4404-ac9b-466a45b4ad9a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035687 Aug 23 22:35:06.593365 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 731/1059] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:35:06.904547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-1c7f07c8-5911-49ad-a7c5-b932f9fdd893 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:06.905430 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-1c7f07c8-5911-49ad-a7c5-b932f9fdd893 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:06.912457 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c7f07c8-5911-49ad-a7c5-b932f9fdd893 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:06.912951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c7f07c8-5911-49ad-a7c5-b932f9fdd893 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:06.913425 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c7f07c8-5911-49ad-a7c5-b932f9fdd893 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:06.914142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c7f07c8-5911-49ad-a7c5-b932f9fdd893 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:06.914597 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c7f07c8-5911-49ad-a7c5-b932f9fdd893 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:06.915023 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-1c7f07c8-5911-49ad-a7c5-b932f9fdd893 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:07.090393 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-1c7f07c8-5911-49ad-a7c5-b932f9fdd893 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:07.100482 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-1c7f07c8-5911-49ad-a7c5-b932f9fdd893 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1260 microversion: 2.1 time: 0.201226 Aug 23 22:35:07.100947 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 732/1060] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:06 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:08.125039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2dcea4a3-0147-4fd7-b0f2-46fe026c8574 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:08.126692 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2dcea4a3-0147-4fd7-b0f2-46fe026c8574 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:08.141203 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dcea4a3-0147-4fd7-b0f2-46fe026c8574 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:08.142153 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dcea4a3-0147-4fd7-b0f2-46fe026c8574 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:08.142719 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dcea4a3-0147-4fd7-b0f2-46fe026c8574 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:08.143552 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dcea4a3-0147-4fd7-b0f2-46fe026c8574 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:08.144016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dcea4a3-0147-4fd7-b0f2-46fe026c8574 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:08.144630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2dcea4a3-0147-4fd7-b0f2-46fe026c8574 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:08.337442 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2dcea4a3-0147-4fd7-b0f2-46fe026c8574 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:08.349422 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2dcea4a3-0147-4fd7-b0f2-46fe026c8574 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1260 microversion: 2.1 time: 0.230027 Aug 23 22:35:08.350251 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 733/1061] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:08 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:09.372281 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-326df4f1-f735-4822-9154-1cd34a7512d5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:09.373439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-326df4f1-f735-4822-9154-1cd34a7512d5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:09.379964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-326df4f1-f735-4822-9154-1cd34a7512d5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:09.380442 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-326df4f1-f735-4822-9154-1cd34a7512d5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:09.380867 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-326df4f1-f735-4822-9154-1cd34a7512d5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:09.381604 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-326df4f1-f735-4822-9154-1cd34a7512d5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:09.382048 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-326df4f1-f735-4822-9154-1cd34a7512d5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:09.382463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-326df4f1-f735-4822-9154-1cd34a7512d5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:09.546180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-326df4f1-f735-4822-9154-1cd34a7512d5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:09.556625 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-326df4f1-f735-4822-9154-1cd34a7512d5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1260 microversion: 2.1 time: 0.188327 Aug 23 22:35:09.557455 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 734/1062] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:09 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:10.578428 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-94b3f622-0338-4f65-903b-9a9bdb69369a tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:10.579106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-94b3f622-0338-4f65-903b-9a9bdb69369a tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:10.585980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94b3f622-0338-4f65-903b-9a9bdb69369a tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:10.586466 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94b3f622-0338-4f65-903b-9a9bdb69369a tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:10.586901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94b3f622-0338-4f65-903b-9a9bdb69369a tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:10.587616 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94b3f622-0338-4f65-903b-9a9bdb69369a tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:10.588062 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94b3f622-0338-4f65-903b-9a9bdb69369a tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:10.588493 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-94b3f622-0338-4f65-903b-9a9bdb69369a tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:10.744725 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-94b3f622-0338-4f65-903b-9a9bdb69369a tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:10.758775 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-94b3f622-0338-4f65-903b-9a9bdb69369a tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1260 microversion: 2.1 time: 0.183750 Aug 23 22:35:10.759932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 735/1063] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:10 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:11.784552 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e9141662-ba9e-4488-bc0b-aa5803a02120 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:11.785302 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e9141662-ba9e-4488-bc0b-aa5803a02120 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:11.792829 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9141662-ba9e-4488-bc0b-aa5803a02120 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:11.793452 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9141662-ba9e-4488-bc0b-aa5803a02120 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:11.793859 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9141662-ba9e-4488-bc0b-aa5803a02120 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:11.794572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9141662-ba9e-4488-bc0b-aa5803a02120 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:11.795092 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9141662-ba9e-4488-bc0b-aa5803a02120 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:11.795854 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e9141662-ba9e-4488-bc0b-aa5803a02120 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:12.239370 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e9141662-ba9e-4488-bc0b-aa5803a02120 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:12.249575 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e9141662-ba9e-4488-bc0b-aa5803a02120 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1260 microversion: 2.1 time: 0.468826 Aug 23 22:35:12.250187 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 736/1064] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:11 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1260 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:13.278039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3ab0b3ff-d969-4730-9a66-4cc57583456b tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:13.279183 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3ab0b3ff-d969-4730-9a66-4cc57583456b tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:13.285617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:13.294938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3ab0b3ff-d969-4730-9a66-4cc57583456b tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:13.295488 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3ab0b3ff-d969-4730-9a66-4cc57583456b tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:13.295990 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3ab0b3ff-d969-4730-9a66-4cc57583456b tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:13.296765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3ab0b3ff-d969-4730-9a66-4cc57583456b tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:13.297577 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3ab0b3ff-d969-4730-9a66-4cc57583456b tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:13.298145 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3ab0b3ff-d969-4730-9a66-4cc57583456b tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:13.351704 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=8 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:13.482718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3ab0b3ff-d969-4730-9a66-4cc57583456b tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:13.502681 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3ab0b3ff-d969-4730-9a66-4cc57583456b tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1260 microversion: 2.1 time: 0.233036 Aug 23 22:35:13.503680 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 737/1065] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:13 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:14.536682 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-84ffb1a9-214a-4cb3-8c2f-d14536139485 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:14.537580 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-84ffb1a9-214a-4cb3-8c2f-d14536139485 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:14.546318 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-84ffb1a9-214a-4cb3-8c2f-d14536139485 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:14.547003 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-84ffb1a9-214a-4cb3-8c2f-d14536139485 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:14.547816 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-84ffb1a9-214a-4cb3-8c2f-d14536139485 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:14.548897 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-84ffb1a9-214a-4cb3-8c2f-d14536139485 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:14.549680 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-84ffb1a9-214a-4cb3-8c2f-d14536139485 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:14.550664 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-84ffb1a9-214a-4cb3-8c2f-d14536139485 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:14.743884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-84ffb1a9-214a-4cb3-8c2f-d14536139485 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:14.753526 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-84ffb1a9-214a-4cb3-8c2f-d14536139485 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1260 microversion: 2.1 time: 0.221574 Aug 23 22:35:14.754114 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 738/1066] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:14 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:15.779663 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b6ee57da-1f14-478f-b4e9-9de569f736af tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:15.780615 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b6ee57da-1f14-478f-b4e9-9de569f736af tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:15.788986 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6ee57da-1f14-478f-b4e9-9de569f736af tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:15.789744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6ee57da-1f14-478f-b4e9-9de569f736af tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:15.790277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6ee57da-1f14-478f-b4e9-9de569f736af tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:15.791102 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6ee57da-1f14-478f-b4e9-9de569f736af tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:15.792651 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6ee57da-1f14-478f-b4e9-9de569f736af tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:15.793343 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-b6ee57da-1f14-478f-b4e9-9de569f736af tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:15.952883 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b6ee57da-1f14-478f-b4e9-9de569f736af tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:15.967691 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b6ee57da-1f14-478f-b4e9-9de569f736af tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1260 microversion: 2.1 time: 0.192817 Aug 23 22:35:15.968769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 739/1067] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:15 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:16.990163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2184edfa-81e5-489c-af4f-9ceaeb81032f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:16.990824 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2184edfa-81e5-489c-af4f-9ceaeb81032f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:16.998648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2184edfa-81e5-489c-af4f-9ceaeb81032f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:16.999128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2184edfa-81e5-489c-af4f-9ceaeb81032f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:16.999562 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2184edfa-81e5-489c-af4f-9ceaeb81032f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:17.000257 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2184edfa-81e5-489c-af4f-9ceaeb81032f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:17.000704 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2184edfa-81e5-489c-af4f-9ceaeb81032f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:17.001150 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2184edfa-81e5-489c-af4f-9ceaeb81032f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:17.147857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2184edfa-81e5-489c-af4f-9ceaeb81032f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:17.156423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2184edfa-81e5-489c-af4f-9ceaeb81032f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1260 microversion: 2.1 time: 0.170720 Aug 23 22:35:17.157007 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 740/1068] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:16 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:35:17.617630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-5ae93c1d-87d9-40ec-a862-e2468cce421a req-1c5f1b89-5ce6-4ad4-ad67-e11d416b4e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b18b61-3c70-4ef9-b21e-8f34cae4d729", "name": "network-vif-plugged", "status": "completed", "tag": "7329ee58-549d-4382-bc19-ec3d07cd19db"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:35:17.627341 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-5ae93c1d-87d9-40ec-a862-e2468cce421a req-1c5f1b89-5ce6-4ad4-ad67-e11d416b4e17 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:17.627849 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-5ae93c1d-87d9-40ec-a862-e2468cce421a req-1c5f1b89-5ce6-4ad4-ad67-e11d416b4e17 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:17.628391 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-5ae93c1d-87d9-40ec-a862-e2468cce421a req-1c5f1b89-5ce6-4ad4-ad67-e11d416b4e17 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:17.642143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-5ae93c1d-87d9-40ec-a862-e2468cce421a req-1c5f1b89-5ce6-4ad4-ad67-e11d416b4e17 service nova] Creating event network-vif-plugged:7329ee58-549d-4382-bc19-ec3d07cd19db for instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 on hv-cinder-85032 Aug 23 22:35:17.647126 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-5ae93c1d-87d9-40ec-a862-e2468cce421a req-1c5f1b89-5ce6-4ad4-ad67-e11d416b4e17 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032994 Aug 23 22:35:17.647740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 741/1069] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:35:18.179016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e6f429a4-3839-4d07-891e-ca094ed593c5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:18.179694 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e6f429a4-3839-4d07-891e-ca094ed593c5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:18.186807 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6f429a4-3839-4d07-891e-ca094ed593c5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:18.187295 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6f429a4-3839-4d07-891e-ca094ed593c5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:18.187727 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6f429a4-3839-4d07-891e-ca094ed593c5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:18.188423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6f429a4-3839-4d07-891e-ca094ed593c5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:18.188870 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6f429a4-3839-4d07-891e-ca094ed593c5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:18.189323 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e6f429a4-3839-4d07-891e-ca094ed593c5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:18.334792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e6f429a4-3839-4d07-891e-ca094ed593c5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:18.343505 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e6f429a4-3839-4d07-891e-ca094ed593c5 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1260 microversion: 2.1 time: 0.169059 Aug 23 22:35:18.344133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 742/1070] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:18 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:19.365711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0be2214f-04ee-45ae-baff-4df3f12909b4 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:19.366477 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0be2214f-04ee-45ae-baff-4df3f12909b4 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:19.373068 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0be2214f-04ee-45ae-baff-4df3f12909b4 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:19.373569 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0be2214f-04ee-45ae-baff-4df3f12909b4 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:19.374008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0be2214f-04ee-45ae-baff-4df3f12909b4 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:19.374740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0be2214f-04ee-45ae-baff-4df3f12909b4 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:19.375194 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0be2214f-04ee-45ae-baff-4df3f12909b4 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:19.375617 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0be2214f-04ee-45ae-baff-4df3f12909b4 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:19.516869 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0be2214f-04ee-45ae-baff-4df3f12909b4 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:19.525170 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0be2214f-04ee-45ae-baff-4df3f12909b4 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1445 microversion: 2.1 time: 0.163384 Aug 23 22:35:19.525760 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 743/1071] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:19 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:19.546045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-572e0b91-fa00-453a-af44-481395e9b807 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:19.546745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-572e0b91-fa00-453a-af44-481395e9b807 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:19.553070 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-572e0b91-fa00-453a-af44-481395e9b807 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:19.553896 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-572e0b91-fa00-453a-af44-481395e9b807 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:19.554335 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-572e0b91-fa00-453a-af44-481395e9b807 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:19.555029 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-572e0b91-fa00-453a-af44-481395e9b807 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:19.555480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-572e0b91-fa00-453a-af44-481395e9b807 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:19.555906 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-572e0b91-fa00-453a-af44-481395e9b807 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:19.704439 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-572e0b91-fa00-453a-af44-481395e9b807 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:19.712480 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-572e0b91-fa00-453a-af44-481395e9b807 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1445 microversion: 2.1 time: 0.170913 Aug 23 22:35:19.713076 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 744/1072] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:19 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1445 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:22.053736 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-cbb4a025-2652-4923-a469-25728bfd4249 req-2155c132-f611-4570-939c-eabeec2b94c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b18b61-3c70-4ef9-b21e-8f34cae4d729", "tag": "7329ee58-549d-4382-bc19-ec3d07cd19db"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:35:22.064936 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-cbb4a025-2652-4923-a469-25728bfd4249 req-2155c132-f611-4570-939c-eabeec2b94c8 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:22.065450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-cbb4a025-2652-4923-a469-25728bfd4249 req-2155c132-f611-4570-939c-eabeec2b94c8 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:22.065877 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-cbb4a025-2652-4923-a469-25728bfd4249 req-2155c132-f611-4570-939c-eabeec2b94c8 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:22.080968 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-cbb4a025-2652-4923-a469-25728bfd4249 req-2155c132-f611-4570-939c-eabeec2b94c8 service nova] Creating event network-changed:7329ee58-549d-4382-bc19-ec3d07cd19db for instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 on hv-cinder-85032 Aug 23 22:35:22.085913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-cbb4a025-2652-4923-a469-25728bfd4249 req-2155c132-f611-4570-939c-eabeec2b94c8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036762 Aug 23 22:35:22.086556 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 745/1073] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:35:57.548379 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:57.549637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=92 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:57.554182 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2147352843", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-861876496", "security_groups": [{"name": "tempest-secgroup-smoke-297031976"}], "block_device_mapping_v2": [{"uuid": "2fce6115-d11e-4b1b-95f2-759d15476631", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd15f43b-dcfe-4caf-8228-7089e7287c38"}]}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:35:57.683219 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.network.neutron [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] validate_networks() for [('dd15f43b-dcfe-4caf-8228-7089e7287c38', None, None, None, None, None)] {{(pid=120856) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 22:35:58.211139 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Flavor limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 22:35:58.211551 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Image limits 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 22:35:58.212036 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Flavor pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 22:35:58.212450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Image pref 0:0:0 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 22:35:58.212855 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.virt.hardware [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120856) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 22:35:58.222167 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:58.222641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:58.223062 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:58.223772 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:58.224218 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:58.224635 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:58.242460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Getting quotas for project 77cc91a5c0bc4e5888460d7618594895. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 22:35:58.246787 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.quota [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Getting quotas for user fa949e48248747369eefd74280441b75 and project 77cc91a5c0bc4e5888460d7618594895. Resources: {'cores', 'instances', 'ram'} {{(pid=120856) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 22:35:58.305498 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Going to run 1 instances... {{(pid=120856) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 22:35:58.307844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fce6115-d11e-4b1b-95f2-759d15476631',volume_size=None,volume_type=None)] {{(pid=120856) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 22:35:58.443383 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-937edd37-a032-40c7-8610-b2eca0f13213 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.899412 Aug 23 22:35:58.444345 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 746/1074] 10.222.0.88 () {60 vars in 1147 bytes} [Tue Aug 23 22:35:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 22:35:58.455488 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-b5ae0675-92ad-4584-b26a-9b19daaaf8fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:58.456110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-b5ae0675-92ad-4584-b26a-9b19daaaf8fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:58.511604 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-b5ae0675-92ad-4584-b26a-9b19daaaf8fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:58.519270 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-b5ae0675-92ad-4584-b26a-9b19daaaf8fd tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1094 microversion: 2.1 time: 0.067502 Aug 23 22:35:58.519780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 747/1075] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:58 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:35:59.541405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-0b74ee9e-a70f-4f09-8775-35dea2dbfe40 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:35:59.542292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-0b74ee9e-a70f-4f09-8775-35dea2dbfe40 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:35:59.549364 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b74ee9e-a70f-4f09-8775-35dea2dbfe40 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:59.549851 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b74ee9e-a70f-4f09-8775-35dea2dbfe40 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:59.550283 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b74ee9e-a70f-4f09-8775-35dea2dbfe40 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:59.550991 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b74ee9e-a70f-4f09-8775-35dea2dbfe40 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:35:59.551433 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b74ee9e-a70f-4f09-8775-35dea2dbfe40 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:35:59.551847 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-0b74ee9e-a70f-4f09-8775-35dea2dbfe40 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:35:59.623581 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-0b74ee9e-a70f-4f09-8775-35dea2dbfe40 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:35:59.632490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-0b74ee9e-a70f-4f09-8775-35dea2dbfe40 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1144 microversion: 2.1 time: 0.094855 Aug 23 22:35:59.632977 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 748/1076] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:35:59 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:00.659929 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-2f25f74a-16e6-4bcb-94e3-d77c5841df5f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:00.661030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-2f25f74a-16e6-4bcb-94e3-d77c5841df5f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:00.675148 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2f25f74a-16e6-4bcb-94e3-d77c5841df5f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:00.676161 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2f25f74a-16e6-4bcb-94e3-d77c5841df5f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:00.677468 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2f25f74a-16e6-4bcb-94e3-d77c5841df5f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:00.678283 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2f25f74a-16e6-4bcb-94e3-d77c5841df5f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:00.679079 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2f25f74a-16e6-4bcb-94e3-d77c5841df5f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:00.679954 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-2f25f74a-16e6-4bcb-94e3-d77c5841df5f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:00.803844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-2f25f74a-16e6-4bcb-94e3-d77c5841df5f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:00.813891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-2f25f74a-16e6-4bcb-94e3-d77c5841df5f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1200 microversion: 2.1 time: 0.161303 Aug 23 22:36:00.814788 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 749/1077] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:00 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1200 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:01.839142 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6433da7b-c291-4be6-bbfc-84dcab64362e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:01.841506 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6433da7b-c291-4be6-bbfc-84dcab64362e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:01.851723 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6433da7b-c291-4be6-bbfc-84dcab64362e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:01.855117 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6433da7b-c291-4be6-bbfc-84dcab64362e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:01.856141 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6433da7b-c291-4be6-bbfc-84dcab64362e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:01.857641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6433da7b-c291-4be6-bbfc-84dcab64362e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:01.858594 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6433da7b-c291-4be6-bbfc-84dcab64362e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:01.859496 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6433da7b-c291-4be6-bbfc-84dcab64362e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:02.080634 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6433da7b-c291-4be6-bbfc-84dcab64362e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:02.091189 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6433da7b-c291-4be6-bbfc-84dcab64362e tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1265 microversion: 2.1 time: 0.257191 Aug 23 22:36:02.091907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 750/1078] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:01 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:02.792637 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-68f2c89a-8eb7-4acd-9dba-d9b863b13e75 req-15cbb960-3a97-48a4-bac2-cd87ae9f86e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5625e47-9abc-4cfb-92ce-33b345585b16", "tag": "aba62dc2-b5bd-413f-8d26-e9a22cdf6133"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:02.810672 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-68f2c89a-8eb7-4acd-9dba-d9b863b13e75 req-15cbb960-3a97-48a4-bac2-cd87ae9f86e5 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:02.811549 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-68f2c89a-8eb7-4acd-9dba-d9b863b13e75 req-15cbb960-3a97-48a4-bac2-cd87ae9f86e5 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:02.812342 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-68f2c89a-8eb7-4acd-9dba-d9b863b13e75 req-15cbb960-3a97-48a4-bac2-cd87ae9f86e5 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:02.836326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-68f2c89a-8eb7-4acd-9dba-d9b863b13e75 req-15cbb960-3a97-48a4-bac2-cd87ae9f86e5 service nova] Creating event network-changed:aba62dc2-b5bd-413f-8d26-e9a22cdf6133 for instance a5625e47-9abc-4cfb-92ce-33b345585b16 on hv-cinder-85032 Aug 23 22:36:02.849123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-68f2c89a-8eb7-4acd-9dba-d9b863b13e75 req-15cbb960-3a97-48a4-bac2-cd87ae9f86e5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291093 Aug 23 22:36:02.850233 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 751/1079] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:36:03.120478 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-3761eb33-c63a-4041-97ce-62dee7a465d8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:03.123054 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-3761eb33-c63a-4041-97ce-62dee7a465d8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:03.132765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3761eb33-c63a-4041-97ce-62dee7a465d8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:03.133701 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3761eb33-c63a-4041-97ce-62dee7a465d8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:03.134499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3761eb33-c63a-4041-97ce-62dee7a465d8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:03.135807 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3761eb33-c63a-4041-97ce-62dee7a465d8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:03.136521 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3761eb33-c63a-4041-97ce-62dee7a465d8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:03.137718 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-3761eb33-c63a-4041-97ce-62dee7a465d8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:03.348810 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-3761eb33-c63a-4041-97ce-62dee7a465d8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:03.361003 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-3761eb33-c63a-4041-97ce-62dee7a465d8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1265 microversion: 2.1 time: 0.247256 Aug 23 22:36:03.361740 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 752/1080] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:03 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:04.387513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-f071c1c5-ff94-47e9-bcf4-fbdb91a78525 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:04.388650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-f071c1c5-ff94-47e9-bcf4-fbdb91a78525 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:04.394798 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f071c1c5-ff94-47e9-bcf4-fbdb91a78525 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:04.395283 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f071c1c5-ff94-47e9-bcf4-fbdb91a78525 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:04.395716 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f071c1c5-ff94-47e9-bcf4-fbdb91a78525 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:04.396432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f071c1c5-ff94-47e9-bcf4-fbdb91a78525 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:04.396884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f071c1c5-ff94-47e9-bcf4-fbdb91a78525 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:04.397336 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-f071c1c5-ff94-47e9-bcf4-fbdb91a78525 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:04.604653 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-f071c1c5-ff94-47e9-bcf4-fbdb91a78525 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:04.622449 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-f071c1c5-ff94-47e9-bcf4-fbdb91a78525 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1265 microversion: 2.1 time: 0.240638 Aug 23 22:36:04.623510 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 753/1081] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:04 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:05.648209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-9fea13e3-8de6-47a1-976f-fc5ac1e909c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:05.648923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-9fea13e3-8de6-47a1-976f-fc5ac1e909c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:05.656765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fea13e3-8de6-47a1-976f-fc5ac1e909c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:05.657296 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fea13e3-8de6-47a1-976f-fc5ac1e909c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:05.657726 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fea13e3-8de6-47a1-976f-fc5ac1e909c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:05.658422 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fea13e3-8de6-47a1-976f-fc5ac1e909c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:05.658872 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fea13e3-8de6-47a1-976f-fc5ac1e909c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:05.659293 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-9fea13e3-8de6-47a1-976f-fc5ac1e909c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:05.808039 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-9fea13e3-8de6-47a1-976f-fc5ac1e909c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:05.816217 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-9fea13e3-8de6-47a1-976f-fc5ac1e909c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1265 microversion: 2.1 time: 0.171984 Aug 23 22:36:05.816844 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 754/1082] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:05 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:06.837012 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d84e3c0a-c96a-40ea-8016-c5db17f8d2f4 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:06.837769 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d84e3c0a-c96a-40ea-8016-c5db17f8d2f4 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:06.844163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d84e3c0a-c96a-40ea-8016-c5db17f8d2f4 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:06.844636 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d84e3c0a-c96a-40ea-8016-c5db17f8d2f4 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:06.845691 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d84e3c0a-c96a-40ea-8016-c5db17f8d2f4 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:06.845840 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d84e3c0a-c96a-40ea-8016-c5db17f8d2f4 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:06.846337 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d84e3c0a-c96a-40ea-8016-c5db17f8d2f4 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:06.846614 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d84e3c0a-c96a-40ea-8016-c5db17f8d2f4 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:06.989248 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-d84e3c0a-c96a-40ea-8016-c5db17f8d2f4 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:06.998765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d84e3c0a-c96a-40ea-8016-c5db17f8d2f4 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1265 microversion: 2.1 time: 0.164902 Aug 23 22:36:06.998765 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 755/1083] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:06 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:08.019833 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fcf69147-bd1f-46fa-97fd-8824d6aa0927 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:08.020513 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fcf69147-bd1f-46fa-97fd-8824d6aa0927 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:08.027972 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf69147-bd1f-46fa-97fd-8824d6aa0927 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:08.028530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf69147-bd1f-46fa-97fd-8824d6aa0927 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:08.029229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf69147-bd1f-46fa-97fd-8824d6aa0927 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:08.029932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf69147-bd1f-46fa-97fd-8824d6aa0927 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:08.030681 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf69147-bd1f-46fa-97fd-8824d6aa0927 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:08.031120 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fcf69147-bd1f-46fa-97fd-8824d6aa0927 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:08.175090 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-fcf69147-bd1f-46fa-97fd-8824d6aa0927 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:08.183110 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fcf69147-bd1f-46fa-97fd-8824d6aa0927 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1265 microversion: 2.1 time: 0.167123 Aug 23 22:36:08.183686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 756/1084] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:08 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:09.204542 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-80c8d7c5-61a9-4b7d-b8cc-40d83a4f3ff8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:09.205292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-80c8d7c5-61a9-4b7d-b8cc-40d83a4f3ff8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:09.207593 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:09.208531 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell0:SELECT=8 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:09.215884 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-80c8d7c5-61a9-4b7d-b8cc-40d83a4f3ff8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:09.216375 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-80c8d7c5-61a9-4b7d-b8cc-40d83a4f3ff8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:09.216816 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-80c8d7c5-61a9-4b7d-b8cc-40d83a4f3ff8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:09.217643 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-80c8d7c5-61a9-4b7d-b8cc-40d83a4f3ff8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:09.218123 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-80c8d7c5-61a9-4b7d-b8cc-40d83a4f3ff8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:09.218550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-80c8d7c5-61a9-4b7d-b8cc-40d83a4f3ff8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:09.374362 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-80c8d7c5-61a9-4b7d-b8cc-40d83a4f3ff8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:09.383594 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-80c8d7c5-61a9-4b7d-b8cc-40d83a4f3ff8 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1265 microversion: 2.1 time: 0.183101 Aug 23 22:36:09.384206 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 757/1085] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:09 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:10.410115 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-671ef369-dc9e-45ef-abbd-e7f060213d3b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:10.411308 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-671ef369-dc9e-45ef-abbd-e7f060213d3b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:10.424956 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-671ef369-dc9e-45ef-abbd-e7f060213d3b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:10.425856 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-671ef369-dc9e-45ef-abbd-e7f060213d3b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:10.426700 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-671ef369-dc9e-45ef-abbd-e7f060213d3b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:10.428147 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-671ef369-dc9e-45ef-abbd-e7f060213d3b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:10.429024 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-671ef369-dc9e-45ef-abbd-e7f060213d3b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:10.429830 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-671ef369-dc9e-45ef-abbd-e7f060213d3b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:10.658423 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-671ef369-dc9e-45ef-abbd-e7f060213d3b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:10.669784 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-671ef369-dc9e-45ef-abbd-e7f060213d3b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1265 microversion: 2.1 time: 0.266523 Aug 23 22:36:10.670268 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 758/1086] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:10 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:11.695599 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6f2a21d0-71e2-4fc6-8f99-d2cf5d4135b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:11.696509 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6f2a21d0-71e2-4fc6-8f99-d2cf5d4135b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:11.704228 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f2a21d0-71e2-4fc6-8f99-d2cf5d4135b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:11.704611 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f2a21d0-71e2-4fc6-8f99-d2cf5d4135b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:11.705187 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f2a21d0-71e2-4fc6-8f99-d2cf5d4135b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:11.705989 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f2a21d0-71e2-4fc6-8f99-d2cf5d4135b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:11.706442 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f2a21d0-71e2-4fc6-8f99-d2cf5d4135b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:11.706974 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6f2a21d0-71e2-4fc6-8f99-d2cf5d4135b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:11.921778 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6f2a21d0-71e2-4fc6-8f99-d2cf5d4135b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:11.930243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6f2a21d0-71e2-4fc6-8f99-d2cf5d4135b9 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1265 microversion: 2.1 time: 0.238549 Aug 23 22:36:11.930893 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 759/1087] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:11 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:12.124859 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-5b24f11b-edc0-4445-8113-5397ed394971 req-dfef9c8f-7915-42b9-8f65-d836a69229b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5625e47-9abc-4cfb-92ce-33b345585b16", "name": "network-vif-plugged", "status": "completed", "tag": "aba62dc2-b5bd-413f-8d26-e9a22cdf6133"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:12.136573 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-5b24f11b-edc0-4445-8113-5397ed394971 req-dfef9c8f-7915-42b9-8f65-d836a69229b9 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:12.137078 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-5b24f11b-edc0-4445-8113-5397ed394971 req-dfef9c8f-7915-42b9-8f65-d836a69229b9 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:12.137512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-5b24f11b-edc0-4445-8113-5397ed394971 req-dfef9c8f-7915-42b9-8f65-d836a69229b9 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:12.152538 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-5b24f11b-edc0-4445-8113-5397ed394971 req-dfef9c8f-7915-42b9-8f65-d836a69229b9 service nova] Creating event network-vif-plugged:aba62dc2-b5bd-413f-8d26-e9a22cdf6133 for instance a5625e47-9abc-4cfb-92ce-33b345585b16 on hv-cinder-85032 Aug 23 22:36:12.161432 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-5b24f11b-edc0-4445-8113-5397ed394971 req-dfef9c8f-7915-42b9-8f65-d836a69229b9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140429 Aug 23 22:36:12.162553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 760/1088] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:36:12.959277 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-531bb180-168f-4bae-a72c-696625cdd36a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:12.960598 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-531bb180-168f-4bae-a72c-696625cdd36a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:12.972571 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-531bb180-168f-4bae-a72c-696625cdd36a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:12.973414 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-531bb180-168f-4bae-a72c-696625cdd36a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:12.973934 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-531bb180-168f-4bae-a72c-696625cdd36a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:12.974665 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-531bb180-168f-4bae-a72c-696625cdd36a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:12.975128 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-531bb180-168f-4bae-a72c-696625cdd36a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:12.975557 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-531bb180-168f-4bae-a72c-696625cdd36a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:13.165451 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-531bb180-168f-4bae-a72c-696625cdd36a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:13.175293 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-531bb180-168f-4bae-a72c-696625cdd36a tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1265 microversion: 2.1 time: 0.225245 Aug 23 22:36:13.175913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 761/1089] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:12 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:14.199389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6ca44750-20c3-4c5c-9038-7b061515bafc tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:14.200144 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6ca44750-20c3-4c5c-9038-7b061515bafc tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:14.207385 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ca44750-20c3-4c5c-9038-7b061515bafc tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:14.208004 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ca44750-20c3-4c5c-9038-7b061515bafc tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:14.208490 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ca44750-20c3-4c5c-9038-7b061515bafc tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:14.209298 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ca44750-20c3-4c5c-9038-7b061515bafc tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:14.209799 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ca44750-20c3-4c5c-9038-7b061515bafc tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:14.210389 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6ca44750-20c3-4c5c-9038-7b061515bafc tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:14.382500 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6ca44750-20c3-4c5c-9038-7b061515bafc tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:14.391348 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6ca44750-20c3-4c5c-9038-7b061515bafc tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1452 microversion: 2.1 time: 0.198471 Aug 23 22:36:14.391931 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 762/1090] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:14 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1452 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:36:14.412016 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-081a1291-4fb6-42b1-b392-09c0196dc660 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:36:14.412628 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-081a1291-4fb6-42b1-b392-09c0196dc660 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:36:14.419045 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-081a1291-4fb6-42b1-b392-09c0196dc660 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:14.419527 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-081a1291-4fb6-42b1-b392-09c0196dc660 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:14.419964 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-081a1291-4fb6-42b1-b392-09c0196dc660 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:14.420652 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-081a1291-4fb6-42b1-b392-09c0196dc660 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:14.421396 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-081a1291-4fb6-42b1-b392-09c0196dc660 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:14.421823 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-081a1291-4fb6-42b1-b392-09c0196dc660 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:14.556709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-081a1291-4fb6-42b1-b392-09c0196dc660 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:36:14.564622 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-081a1291-4fb6-42b1-b392-09c0196dc660 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1452 microversion: 2.1 time: 0.156369 Aug 23 22:36:14.565213 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 763/1091] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:36:14 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:36:16.416309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-374722cc-9b26-4ef6-a617-b937c15244fe req-894d81b7-14bc-4d26-ad46-31a86f97d50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5625e47-9abc-4cfb-92ce-33b345585b16", "tag": "aba62dc2-b5bd-413f-8d26-e9a22cdf6133"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:36:16.426461 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-374722cc-9b26-4ef6-a617-b937c15244fe req-894d81b7-14bc-4d26-ad46-31a86f97d50a service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:36:16.426940 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-374722cc-9b26-4ef6-a617-b937c15244fe req-894d81b7-14bc-4d26-ad46-31a86f97d50a service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:36:16.427359 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-374722cc-9b26-4ef6-a617-b937c15244fe req-894d81b7-14bc-4d26-ad46-31a86f97d50a service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:36:16.452553 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-374722cc-9b26-4ef6-a617-b937c15244fe req-894d81b7-14bc-4d26-ad46-31a86f97d50a service nova] Creating event network-changed:aba62dc2-b5bd-413f-8d26-e9a22cdf6133 for instance a5625e47-9abc-4cfb-92ce-33b345585b16 on hv-cinder-85032 Aug 23 22:36:16.457996 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-374722cc-9b26-4ef6-a617-b937c15244fe req-894d81b7-14bc-4d26-ad46-31a86f97d50a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116424 Aug 23 22:36:16.458608 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 764/1092] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:37:44.532174 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:44.533199 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=92 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:44.537731 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-bd31cb50-1633-4bdf-afd5-8354a3e0903c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:44.538364 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bd31cb50-1633-4bdf-afd5-8354a3e0903c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:44.547736 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd31cb50-1633-4bdf-afd5-8354a3e0903c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:44.548228 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd31cb50-1633-4bdf-afd5-8354a3e0903c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:44.548657 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd31cb50-1633-4bdf-afd5-8354a3e0903c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:44.549450 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd31cb50-1633-4bdf-afd5-8354a3e0903c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:44.549901 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd31cb50-1633-4bdf-afd5-8354a3e0903c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:44.550319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-bd31cb50-1633-4bdf-afd5-8354a3e0903c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:44.581325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-bd31cb50-1633-4bdf-afd5-8354a3e0903c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:37:44.677707 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-bd31cb50-1633-4bdf-afd5-8354a3e0903c tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 204 len: 0 microversion: 2.1 time: 0.149020 Aug 23 22:37:44.681183 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 765/1093] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:37:44 2022] DELETE /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 22:37:44.688278 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-25aa2b84-09c9-417d-8672-a3c91c243582 req-ef3fbc0d-f06c-415a-b54b-42363fc1f4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5625e47-9abc-4cfb-92ce-33b345585b16", "tag": "aba62dc2-b5bd-413f-8d26-e9a22cdf6133"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:44.698301 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-25aa2b84-09c9-417d-8672-a3c91c243582 req-ef3fbc0d-f06c-415a-b54b-42363fc1f4c3 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:44.698838 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-25aa2b84-09c9-417d-8672-a3c91c243582 req-ef3fbc0d-f06c-415a-b54b-42363fc1f4c3 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:44.699257 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-25aa2b84-09c9-417d-8672-a3c91c243582 req-ef3fbc0d-f06c-415a-b54b-42363fc1f4c3 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:44.711806 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-25aa2b84-09c9-417d-8672-a3c91c243582 req-ef3fbc0d-f06c-415a-b54b-42363fc1f4c3 service nova] Creating event network-changed:aba62dc2-b5bd-413f-8d26-e9a22cdf6133 for instance a5625e47-9abc-4cfb-92ce-33b345585b16 on hv-cinder-85032 Aug 23 22:37:44.716745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-25aa2b84-09c9-417d-8672-a3c91c243582 req-ef3fbc0d-f06c-415a-b54b-42363fc1f4c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033672 Aug 23 22:37:44.717415 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 766/1094] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:37:44.723062 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-c9ceaa94-a539-4e2b-957a-711a62a366c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:44.723759 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-c9ceaa94-a539-4e2b-957a-711a62a366c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:44.730317 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c9ceaa94-a539-4e2b-957a-711a62a366c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:44.730801 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c9ceaa94-a539-4e2b-957a-711a62a366c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:44.731229 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c9ceaa94-a539-4e2b-957a-711a62a366c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:44.731923 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c9ceaa94-a539-4e2b-957a-711a62a366c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:44.732370 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c9ceaa94-a539-4e2b-957a-711a62a366c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:44.732791 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-c9ceaa94-a539-4e2b-957a-711a62a366c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:44.897282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-c9ceaa94-a539-4e2b-957a-711a62a366c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:44.905349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-c9ceaa94-a539-4e2b-957a-711a62a366c5 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1577 microversion: 2.1 time: 0.186298 Aug 23 22:37:44.905932 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 767/1095] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:44 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:45.926443 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-082a4773-dbc9-43c2-8eeb-2ef02bacfd98 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:45.927144 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-082a4773-dbc9-43c2-8eeb-2ef02bacfd98 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:45.933941 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-082a4773-dbc9-43c2-8eeb-2ef02bacfd98 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:45.934414 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-082a4773-dbc9-43c2-8eeb-2ef02bacfd98 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:45.934933 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-082a4773-dbc9-43c2-8eeb-2ef02bacfd98 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:45.935648 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-082a4773-dbc9-43c2-8eeb-2ef02bacfd98 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:45.936149 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-082a4773-dbc9-43c2-8eeb-2ef02bacfd98 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:45.936572 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-082a4773-dbc9-43c2-8eeb-2ef02bacfd98 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:46.347583 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-082a4773-dbc9-43c2-8eeb-2ef02bacfd98 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:46.357258 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-082a4773-dbc9-43c2-8eeb-2ef02bacfd98 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1577 microversion: 2.1 time: 0.434431 Aug 23 22:37:46.357857 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 768/1096] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:45 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1577 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:46.890956 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-658fad00-f835-4e90-8fa0-82775f45829c req-619aa82d-cfc7-4740-b06a-584188cb6957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5625e47-9abc-4cfb-92ce-33b345585b16", "name": "network-vif-deleted", "tag": "aba62dc2-b5bd-413f-8d26-e9a22cdf6133"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:46.908049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-658fad00-f835-4e90-8fa0-82775f45829c req-619aa82d-cfc7-4740-b06a-584188cb6957 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:46.908976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-658fad00-f835-4e90-8fa0-82775f45829c req-619aa82d-cfc7-4740-b06a-584188cb6957 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:46.908976 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-658fad00-f835-4e90-8fa0-82775f45829c req-619aa82d-cfc7-4740-b06a-584188cb6957 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:46.924360 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-658fad00-f835-4e90-8fa0-82775f45829c req-619aa82d-cfc7-4740-b06a-584188cb6957 service nova] Creating event network-vif-deleted:aba62dc2-b5bd-413f-8d26-e9a22cdf6133 for instance a5625e47-9abc-4cfb-92ce-33b345585b16 on hv-cinder-85032 Aug 23 22:37:46.929554 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-658fad00-f835-4e90-8fa0-82775f45829c req-619aa82d-cfc7-4740-b06a-584188cb6957 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042919 Aug 23 22:37:46.930779 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 769/1097] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:37:47.383618 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:47.384485 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:47.394756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:47.395327 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:47.395916 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:47.396975 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:47.397707 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:47.398326 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:47.443050 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:47.443522 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:47.444134 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:47.444813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.objects.instance [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lazy-loading 'fault' on Instance uuid a5625e47-9abc-4cfb-92ce-33b345585b16 {{(pid=120856) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 22:37:47.496841 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:47.510407 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-99565b1f-f5ee-4bc1-97fb-91f8024c39f6 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 200 len: 1396 microversion: 2.1 time: 0.132154 Aug 23 22:37:47.511440 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 770/1098] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:47 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 1396 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:48.533807 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:48.534582 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: a5625e47-9abc-4cfb-92ce-33b345585b16] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:48.540850 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:48.541363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:48.541792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:48.542545 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:48.542979 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:48.543400 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:48.558260 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] HTTP exception thrown: Instance a5625e47-9abc-4cfb-92ce-33b345585b16 could not be found. Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Request method failure captured: Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 HTTP/1.1 Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVUHQ9KOiFkIhHHBItYgvG70HIWA8UE-WMaCGxfXiaQwiPqXTB-hymK87YMg2jRK8UvqLSgdgKz_cPJKtPbEcj4o_3_kCelNuDxrau8D6-S4gIFUMj39vwERq2LDIDbIX7xT2ZdeUlkuoUxg_HlOo4n_NR4FkTpRcxtUJ0oO9DdKwSc Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 77cc91a5c0bc4e5888460d7618594895 Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:37:48.559771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/77cc91a5c0bc4e5888460d7618594895"}]}] Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 77cc91a5c0bc4e5888460d7618594895 Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-TestVolumeBootPattern-468979576-project Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: fa949e48248747369eefd74280441b75 Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-TestVolumeBootPattern-468979576-project Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance a5625e47-9abc-4cfb-92ce-33b345585b16 could not be found. Aug 23 22:37:48.561946 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'a5625e47-9abc-4cfb-92ce-33b345585b16'} Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5625e47-9abc-4cfb-92ce-33b345585b16 could not be found. Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:37:48.562744 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5625e47-9abc-4cfb-92ce-33b345585b16 could not be found. Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5625e47-9abc-4cfb-92ce-33b345585b16 could not be found. Aug 23 22:37:48.564067 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:48.565292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Returning 404 to user: Instance a5625e47-9abc-4cfb-92ce-33b345585b16 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:37:48.565292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-ba5e3a09-e367-4342-a6b6-691ed78dcdf7 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16" status: 404 len: 111 microversion: 2.1 time: 0.031923 Aug 23 22:37:48.565292 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 771/1099] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:48 2022] GET /compute/v2.1/servers/a5625e47-9abc-4cfb-92ce-33b345585b16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:37:51.715325 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d501a826-7584-49f2-bae4-09e05f38f424 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:51.716014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d501a826-7584-49f2-bae4-09e05f38f424 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:51.724830 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d501a826-7584-49f2-bae4-09e05f38f424 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:51.725435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d501a826-7584-49f2-bae4-09e05f38f424 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:51.725938 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d501a826-7584-49f2-bae4-09e05f38f424 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:51.726666 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d501a826-7584-49f2-bae4-09e05f38f424 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:51.727200 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d501a826-7584-49f2-bae4-09e05f38f424 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:51.727547 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-d501a826-7584-49f2-bae4-09e05f38f424 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:51.758812 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-d501a826-7584-49f2-bae4-09e05f38f424 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:37:51.848893 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d501a826-7584-49f2-bae4-09e05f38f424 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "DELETE /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 204 len: 0 microversion: 2.1 time: 0.141290 Aug 23 22:37:51.849764 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 772/1100] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:37:51 2022] DELETE /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:37:51.855644 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-834dc6c7-7f3c-4625-9b64-82941fbfd371 req-7ec9a409-b723-449f-b0b7-56b4d4492b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195eae82-7b86-4fc2-933b-1f5878f63036", "tag": "052e7b11-c246-43df-be23-a986bf10bdd8"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:51.865333 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-834dc6c7-7f3c-4625-9b64-82941fbfd371 req-7ec9a409-b723-449f-b0b7-56b4d4492b70 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:51.865815 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-834dc6c7-7f3c-4625-9b64-82941fbfd371 req-7ec9a409-b723-449f-b0b7-56b4d4492b70 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:51.866243 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-834dc6c7-7f3c-4625-9b64-82941fbfd371 req-7ec9a409-b723-449f-b0b7-56b4d4492b70 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:51.878913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-834dc6c7-7f3c-4625-9b64-82941fbfd371 req-7ec9a409-b723-449f-b0b7-56b4d4492b70 service nova] Creating event network-changed:052e7b11-c246-43df-be23-a986bf10bdd8 for instance 195eae82-7b86-4fc2-933b-1f5878f63036 on hv-cinder-85032 Aug 23 22:37:51.884267 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-834dc6c7-7f3c-4625-9b64-82941fbfd371 req-7ec9a409-b723-449f-b0b7-56b4d4492b70 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032859 Aug 23 22:37:51.884875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 773/1101] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:37:51.890832 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e1f8e49d-4774-4904-9034-967420f7048d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:51.891558 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e1f8e49d-4774-4904-9034-967420f7048d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:51.897859 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1f8e49d-4774-4904-9034-967420f7048d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:51.898339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1f8e49d-4774-4904-9034-967420f7048d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:51.898771 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1f8e49d-4774-4904-9034-967420f7048d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:51.899473 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1f8e49d-4774-4904-9034-967420f7048d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:51.899913 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1f8e49d-4774-4904-9034-967420f7048d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:51.900334 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e1f8e49d-4774-4904-9034-967420f7048d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:52.049193 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-e1f8e49d-4774-4904-9034-967420f7048d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:52.057106 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e1f8e49d-4774-4904-9034-967420f7048d tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1575 microversion: 2.1 time: 0.171008 Aug 23 22:37:52.057687 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 774/1102] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:51 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:37:53.080712 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-39fe5010-1357-4862-8f0d-93e124201ba3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:53.081444 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-39fe5010-1357-4862-8f0d-93e124201ba3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:53.089183 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39fe5010-1357-4862-8f0d-93e124201ba3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:53.089756 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39fe5010-1357-4862-8f0d-93e124201ba3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:53.090319 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39fe5010-1357-4862-8f0d-93e124201ba3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:53.091129 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39fe5010-1357-4862-8f0d-93e124201ba3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:53.091660 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39fe5010-1357-4862-8f0d-93e124201ba3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:53.092178 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-39fe5010-1357-4862-8f0d-93e124201ba3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:53.270287 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-39fe5010-1357-4862-8f0d-93e124201ba3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:53.279355 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-39fe5010-1357-4862-8f0d-93e124201ba3 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1575 microversion: 2.1 time: 0.203325 Aug 23 22:37:53.279820 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 775/1103] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:53 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:54.048995 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-53a510d6-66bf-44e4-a311-5cf11f7fecb1 req-031e9121-1674-4139-86f1-979f10d05c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195eae82-7b86-4fc2-933b-1f5878f63036", "name": "network-vif-deleted", "tag": "052e7b11-c246-43df-be23-a986bf10bdd8"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:37:54.067861 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-53a510d6-66bf-44e4-a311-5cf11f7fecb1 req-031e9121-1674-4139-86f1-979f10d05c7f service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:54.068338 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-53a510d6-66bf-44e4-a311-5cf11f7fecb1 req-031e9121-1674-4139-86f1-979f10d05c7f service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:54.068792 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-53a510d6-66bf-44e4-a311-5cf11f7fecb1 req-031e9121-1674-4139-86f1-979f10d05c7f service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:54.081951 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-53a510d6-66bf-44e4-a311-5cf11f7fecb1 req-031e9121-1674-4139-86f1-979f10d05c7f service nova] Creating event network-vif-deleted:052e7b11-c246-43df-be23-a986bf10bdd8 for instance 195eae82-7b86-4fc2-933b-1f5878f63036 on hv-cinder-85032 Aug 23 22:37:54.087041 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-53a510d6-66bf-44e4-a311-5cf11f7fecb1 req-031e9121-1674-4139-86f1-979f10d05c7f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042908 Aug 23 22:37:54.087650 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 776/1104] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:37:54.310306 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-24a55869-208b-4d35-a5d6-beb87138b582 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:54.312250 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-24a55869-208b-4d35-a5d6-beb87138b582 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:54.324387 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24a55869-208b-4d35-a5d6-beb87138b582 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:54.325304 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24a55869-208b-4d35-a5d6-beb87138b582 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:54.326094 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24a55869-208b-4d35-a5d6-beb87138b582 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:54.328610 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24a55869-208b-4d35-a5d6-beb87138b582 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:54.329481 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24a55869-208b-4d35-a5d6-beb87138b582 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:54.330302 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-24a55869-208b-4d35-a5d6-beb87138b582 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:54.424611 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-24a55869-208b-4d35-a5d6-beb87138b582 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa949e48248747369eefd74280441b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cc91a5c0bc4e5888460d7618594895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:37:54.438508 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-24a55869-208b-4d35-a5d6-beb87138b582 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 200 len: 1224 microversion: 2.1 time: 0.137926 Aug 23 22:37:54.439463 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 777/1105] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:54 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 1224 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 22:37:54.494315 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:37:54.494647 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Tue Aug 23 22:37:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:37:55.462715 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:55.463655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: 195eae82-7b86-4fc2-933b-1f5878f63036] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:55.470875 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:55.471435 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:55.471988 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:55.472853 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:55.473519 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:55.474044 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:55.490460 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] HTTP exception thrown: Instance 195eae82-7b86-4fc2-933b-1f5878f63036 could not be found. Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Request method failure captured: Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 HTTP/1.1 Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVUHQ9KOiFkIhHHBItYgvG70HIWA8UE-WMaCGxfXiaQwiPqXTB-hymK87YMg2jRK8UvqLSgdgKz_cPJKtPbEcj4o_3_kCelNuDxrau8D6-S4gIFUMj39vwERq2LDIDbIX7xT2ZdeUlkuoUxg_HlOo4n_NR4FkTpRcxtUJ0oO9DdKwSc Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 77cc91a5c0bc4e5888460d7618594895 Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:37:55.492133 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/77cc91a5c0bc4e5888460d7618594895"}]}] Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 77cc91a5c0bc4e5888460d7618594895 Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-TestVolumeBootPattern-468979576-project Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: fa949e48248747369eefd74280441b75 Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-TestVolumeBootPattern-468979576-project Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance 195eae82-7b86-4fc2-933b-1f5878f63036 could not be found. Aug 23 22:37:55.494780 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': '195eae82-7b86-4fc2-933b-1f5878f63036'} Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 195eae82-7b86-4fc2-933b-1f5878f63036 could not be found. Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:37:55.495745 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 195eae82-7b86-4fc2-933b-1f5878f63036 could not be found. Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 195eae82-7b86-4fc2-933b-1f5878f63036 could not be found. Aug 23 22:37:55.497405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:55.501037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Returning 404 to user: Instance 195eae82-7b86-4fc2-933b-1f5878f63036 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:37:55.501037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-67d34db6-ed76-4984-853c-c437ffe3e91b tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036" status: 404 len: 111 microversion: 2.1 time: 0.035002 Aug 23 22:37:55.501037 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 778/1106] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:55 2022] GET /compute/v2.1/servers/195eae82-7b86-4fc2-933b-1f5878f63036 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:37:56.038655 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:56.039163 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:56.046309 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:56.046793 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:56.047224 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:56.047939 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:56.048386 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:56.048813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:56.066826 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] HTTP exception thrown: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Request method failure captured: Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: DELETE /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e HTTP/1.1 Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVUHQ9KOiFkIhHHBItYgvG70HIWA8UE-WMaCGxfXiaQwiPqXTB-hymK87YMg2jRK8UvqLSgdgKz_cPJKtPbEcj4o_3_kCelNuDxrau8D6-S4gIFUMj39vwERq2LDIDbIX7xT2ZdeUlkuoUxg_HlOo4n_NR4FkTpRcxtUJ0oO9DdKwSc Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 77cc91a5c0bc4e5888460d7618594895 Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:37:56.068512 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/77cc91a5c0bc4e5888460d7618594895"}]}] Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 77cc91a5c0bc4e5888460d7618594895 Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-TestVolumeBootPattern-468979576-project Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: fa949e48248747369eefd74280441b75 Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-TestVolumeBootPattern-468979576-project Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:37:56.070136 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e'} Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:37:56.070965 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:37:56.072426 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:56.074184 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Returning 404 to user: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:37:56.074184 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-36580566-476f-42ba-baa2-229b422f6891 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 404 len: 111 microversion: 2.1 time: 0.035582 Aug 23 22:37:56.074184 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 779/1107] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:37:56 2022] DELETE /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:37:56.079361 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:56.079980 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] [instance: e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:37:56.086504 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:56.087036 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:56.087560 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:56.088279 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:37:56.088737 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:37:56.089195 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:37:56.105477 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] HTTP exception thrown: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Request method failure captured: Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e HTTP/1.1 Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVUHQ9KOiFkIhHHBItYgvG70HIWA8UE-WMaCGxfXiaQwiPqXTB-hymK87YMg2jRK8UvqLSgdgKz_cPJKtPbEcj4o_3_kCelNuDxrau8D6-S4gIFUMj39vwERq2LDIDbIX7xT2ZdeUlkuoUxg_HlOo4n_NR4FkTpRcxtUJ0oO9DdKwSc Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 77cc91a5c0bc4e5888460d7618594895 Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:37:56.107049 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/77cc91a5c0bc4e5888460d7618594895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/77cc91a5c0bc4e5888460d7618594895"}]}] Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 77cc91a5c0bc4e5888460d7618594895 Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-TestVolumeBootPattern-468979576 Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-TestVolumeBootPattern-468979576-project Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: fa949e48248747369eefd74280441b75 Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-TestVolumeBootPattern-468979576-project Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:37:56.109671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e'} Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:37:56.110686 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. Aug 23 22:37:56.112272 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:37:56.113809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Returning 404 to user: Instance e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:37:56.113809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e849706d-cca9-4788-bee1-0f6257eab37f tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e" status: 404 len: 111 microversion: 2.1 time: 0.034746 Aug 23 22:37:56.113809 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 780/1108] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:37:56 2022] GET /compute/v2.1/servers/e2b0387e-97fd-4e7c-a438-12c5c3dcbe6e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 22:37:57.456500 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-e19e1332-f8a4-4fd0-9404-3f4908157a23 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] Calling method '.version_select at 0x7f90309e3280>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:37:57.486540 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-e19e1332-f8a4-4fd0-9404-3f4908157a23 tempest-TestVolumeBootPattern-468979576 tempest-TestVolumeBootPattern-468979576-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-861876496" status: 202 len: 0 microversion: 2.1 time: 0.038559 Aug 23 22:37:57.487721 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 781/1109] 10.222.0.88 () {58 vars in 1260 bytes} [Tue Aug 23 22:37:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-861876496 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 22:38:55.695271 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:55.696011 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG dbcounter [-] [120856] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:55.700407 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-373c490b-7795-425d-b87f-547c1887cd25 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:55.702604 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-373c490b-7795-425d-b87f-547c1887cd25 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:55.711368 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-373c490b-7795-425d-b87f-547c1887cd25 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:55.711893 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-373c490b-7795-425d-b87f-547c1887cd25 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:55.712329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-373c490b-7795-425d-b87f-547c1887cd25 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:55.713014 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-373c490b-7795-425d-b87f-547c1887cd25 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:55.713487 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-373c490b-7795-425d-b87f-547c1887cd25 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:55.713909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-373c490b-7795-425d-b87f-547c1887cd25 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:55.806408 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-373c490b-7795-425d-b87f-547c1887cd25 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "POST /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729/action" status: 200 len: 14 microversion: 2.1 time: 0.112486 Aug 23 22:38:55.807282 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 782/1110] 10.222.0.88 () {60 vars in 1278 bytes} [Tue Aug 23 22:38:55 2022] POST /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 22:38:56.711711 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5e543afb-4f3b-47fe-a996-3b35777c0ef7 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:56.712363 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5e543afb-4f3b-47fe-a996-3b35777c0ef7 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:56.719588 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e543afb-4f3b-47fe-a996-3b35777c0ef7 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.720143 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e543afb-4f3b-47fe-a996-3b35777c0ef7 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.720641 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e543afb-4f3b-47fe-a996-3b35777c0ef7 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:56.721465 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e543afb-4f3b-47fe-a996-3b35777c0ef7 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.721916 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e543afb-4f3b-47fe-a996-3b35777c0ef7 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.722339 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5e543afb-4f3b-47fe-a996-3b35777c0ef7 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:56.751714 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5e543afb-4f3b-47fe-a996-3b35777c0ef7 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Going to try to terminate instance {{(pid=120856) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 22:38:56.843748 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5e543afb-4f3b-47fe-a996-3b35777c0ef7 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 204 len: 0 microversion: 2.1 time: 0.136735 Aug 23 22:38:56.847530 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 783/1111] 10.222.0.88 () {58 vars in 1239 bytes} [Tue Aug 23 22:38:56 2022] DELETE /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 22:38:56.850750 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-f64c58bb-7a34-45e5-9dd8-55609f986b6b req-ffaec5ac-b260-4895-8cc1-b1dafd100fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b18b61-3c70-4ef9-b21e-8f34cae4d729", "tag": "7329ee58-549d-4382-bc19-ec3d07cd19db"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:56.862671 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-f64c58bb-7a34-45e5-9dd8-55609f986b6b req-ffaec5ac-b260-4895-8cc1-b1dafd100fe5 service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.863203 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-f64c58bb-7a34-45e5-9dd8-55609f986b6b req-ffaec5ac-b260-4895-8cc1-b1dafd100fe5 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.864211 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-f64c58bb-7a34-45e5-9dd8-55609f986b6b req-ffaec5ac-b260-4895-8cc1-b1dafd100fe5 service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:56.875783 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-f64c58bb-7a34-45e5-9dd8-55609f986b6b req-ffaec5ac-b260-4895-8cc1-b1dafd100fe5 service nova] Creating event network-changed:7329ee58-549d-4382-bc19-ec3d07cd19db for instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 on hv-cinder-85032 Aug 23 22:38:56.881047 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-f64c58bb-7a34-45e5-9dd8-55609f986b6b req-ffaec5ac-b260-4895-8cc1-b1dafd100fe5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035220 Aug 23 22:38:56.881690 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 784/1112] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 22:38:56.889494 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-5b56ba35-e702-4ba7-9d8b-5dae55aecc6f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:56.890341 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-5b56ba35-e702-4ba7-9d8b-5dae55aecc6f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:56.896533 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b56ba35-e702-4ba7-9d8b-5dae55aecc6f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.897008 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b56ba35-e702-4ba7-9d8b-5dae55aecc6f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.897471 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b56ba35-e702-4ba7-9d8b-5dae55aecc6f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:56.898162 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b56ba35-e702-4ba7-9d8b-5dae55aecc6f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:56.898603 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b56ba35-e702-4ba7-9d8b-5dae55aecc6f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:56.899020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-5b56ba35-e702-4ba7-9d8b-5dae55aecc6f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:57.040842 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-5b56ba35-e702-4ba7-9d8b-5dae55aecc6f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:57.049280 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-5b56ba35-e702-4ba7-9d8b-5dae55aecc6f tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1570 microversion: 2.1 time: 0.163766 Aug 23 22:38:57.049852 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 785/1113] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:56 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:58.071115 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-cd12bac6-0ff5-4e4a-8bd2-a3117d702a86 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:58.071908 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-cd12bac6-0ff5-4e4a-8bd2-a3117d702a86 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:58.078499 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd12bac6-0ff5-4e4a-8bd2-a3117d702a86 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:58.078994 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd12bac6-0ff5-4e4a-8bd2-a3117d702a86 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:58.079416 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd12bac6-0ff5-4e4a-8bd2-a3117d702a86 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:58.080108 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd12bac6-0ff5-4e4a-8bd2-a3117d702a86 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:58.080550 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd12bac6-0ff5-4e4a-8bd2-a3117d702a86 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:58.080962 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-cd12bac6-0ff5-4e4a-8bd2-a3117d702a86 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:58.296813 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-cd12bac6-0ff5-4e4a-8bd2-a3117d702a86 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:58.305155 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-cd12bac6-0ff5-4e4a-8bd2-a3117d702a86 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1570 microversion: 2.1 time: 0.238527 Aug 23 22:38:58.305732 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 786/1114] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:58 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1570 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:38:59.292168 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [req-49ecb1a2-1770-4bd5-95c5-4adb20a1f453 req-ea2a87e4-2732-4a50-9e53-49c88fe9232f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b18b61-3c70-4ef9-b21e-8f34cae4d729", "name": "network-vif-deleted", "tag": "7329ee58-549d-4382-bc19-ec3d07cd19db"}]} {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 22:38:59.302982 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-49ecb1a2-1770-4bd5-95c5-4adb20a1f453 req-ea2a87e4-2732-4a50-9e53-49c88fe9232f service nova] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:59.303209 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-49ecb1a2-1770-4bd5-95c5-4adb20a1f453 req-ea2a87e4-2732-4a50-9e53-49c88fe9232f service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:59.303541 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [req-49ecb1a2-1770-4bd5-95c5-4adb20a1f453 req-ea2a87e4-2732-4a50-9e53-49c88fe9232f service nova] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:59.315075 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.compute.server_external_events [req-49ecb1a2-1770-4bd5-95c5-4adb20a1f453 req-ea2a87e4-2732-4a50-9e53-49c88fe9232f service nova] Creating event network-vif-deleted:7329ee58-549d-4382-bc19-ec3d07cd19db for instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 on hv-cinder-85032 Aug 23 22:38:59.321479 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [req-49ecb1a2-1770-4bd5-95c5-4adb20a1f453 req-ea2a87e4-2732-4a50-9e53-49c88fe9232f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032929 Aug 23 22:38:59.322502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 787/1115] 10.222.0.88 () {64 vars in 1317 bytes} [Tue Aug 23 22:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 22:38:59.327529 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-6d2e038a-1a59-4577-8635-060e74b42cf8 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:38:59.328223 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-6d2e038a-1a59-4577-8635-060e74b42cf8 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:38:59.335405 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d2e038a-1a59-4577-8635-060e74b42cf8 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:59.335885 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d2e038a-1a59-4577-8635-060e74b42cf8 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:59.336494 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d2e038a-1a59-4577-8635-060e74b42cf8 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:59.337020 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d2e038a-1a59-4577-8635-060e74b42cf8 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:38:59.337502 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d2e038a-1a59-4577-8635-060e74b42cf8 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:38:59.337926 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-6d2e038a-1a59-4577-8635-060e74b42cf8 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:38:59.674912 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.policy [None req-6d2e038a-1a59-4577-8635-060e74b42cf8 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a43d4ec9b1346e3a69b01d3d6e83a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a56fcfc827430fb1b73dcfd186024d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120856) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 22:38:59.682784 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-6d2e038a-1a59-4577-8635-060e74b42cf8 tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 200 len: 1219 microversion: 2.1 time: 0.359176 Aug 23 22:38:59.683349 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 788/1116] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:38:59 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 1219 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 22:39:00.703907 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:00.704709 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.compute.api [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] [instance: c5b18b61-3c70-4ef9-b21e-8f34cae4d729] Fetching instance by UUID {{(pid=120856) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 22:39:00.714868 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:00.715760 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:00.716590 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:00.717630 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Acquiring lock "c6226fde-aea4-42e2-ab82-e776e5887d31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 22:39:00.718300 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 22:39:00.719030 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG oslo_concurrency.lockutils [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Lock "c6226fde-aea4-42e2-ab82-e776e5887d31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 22:39:00.739111 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.wsgi [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] HTTP exception thrown: Instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 could not be found. Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Request method failure captured: Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: request: GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 HTTP/1.1 Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept: application/json Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Accept-Encoding: identity Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Connection: close Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Length: 0 Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Content-Type: application/json Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Host: 10.222.0.88 Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Openstack-System-Scope: None Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: User-Agent: python-urllib3/1.26.11 Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Auth-Token: gAAAAABjBVX4vcWfEt5FCbOr6Bh6r4QKaZA78TbXiWJ8tZRM7c_u2j6jzkXPXdGmK2PZGlRIGy1zwai2FdNW5LurXaMh58xjjo9uvAS_S4wzv_Q0KsHsWyEvHM46djA_dXh04aQqzjP-bLqRkOwDBrMTG03-YZBpF6bKmLsj_En1tmDGLxUKK_Q Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Id: None Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Domain-Name: None Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Identity-Status: Confirmed Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Is-Admin-Project: True Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Id: default Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Domain-Name: Default Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Id: 94a56fcfc827430fb1b73dcfd186024d Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Project-Name: tempest-TestShelveInstance-1158478442 Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Role: member,reader Aug 23 22:39:00.740909 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Roles: member,reader Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/94a56fcfc827430fb1b73dcfd186024d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.88:8080", "publicURL": "http://10.222.0.88:8080/v1/AUTH_94a56fcfc827430fb1b73dcfd186024d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/94a56fcfc827430fb1b73dcfd186024d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/94a56fcfc827430fb1b73dcfd186024d"}]}] Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant: tempest-TestShelveInstance-1158478442 Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Id: 94a56fcfc827430fb1b73dcfd186024d Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-Tenant-Name: tempest-TestShelveInstance-1158478442 Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User: tempest-TestShelveInstance-1158478442-project Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Id: default Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Domain-Name: Default Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Id: 7a43d4ec9b1346e3a69b01d3d6e83a98 Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: X-User-Name: tempest-TestShelveInstance-1158478442-project Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: method: > Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: exception: Instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 could not be found. Aug 23 22:39:00.742891 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: action_args: {'id': 'c5b18b61-3c70-4ef9-b21e-8f34cae4d729'} Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 could not be found. Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 22:39:00.744180 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 could not be found. Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 could not be found. Aug 23 22:39:00.746543 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: ERROR nova.api.openstack.wsgi Aug 23 22:39:00.748445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Returning 404 to user: Instance c5b18b61-3c70-4ef9-b21e-8f34cae4d729 could not be found. {{(pid=120856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 22:39:00.748445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-fea10d1a-2d64-4bca-a722-890480869cae tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729" status: 404 len: 111 microversion: 2.1 time: 0.042389 Aug 23 22:39:00.748445 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 789/1117] 10.222.0.88 () {58 vars in 1236 bytes} [Tue Aug 23 22:39:00 2022] GET /compute/v2.1/servers/c5b18b61-3c70-4ef9-b21e-8f34cae4d729 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 22:39:00.912753 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: DEBUG nova.api.openstack.wsgi [None req-d0d5e832-bbd9-42e5-a8ed-94a87d91b2ad tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] Calling method '.version_select at 0x7f902c0df3a0>' {{(pid=120856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 22:39:00.933419 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO nova.api.openstack.requestlog [None req-d0d5e832-bbd9-42e5-a8ed-94a87d91b2ad tempest-TestShelveInstance-1158478442 tempest-TestShelveInstance-1158478442-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-398648710" status: 202 len: 0 microversion: 2.1 time: 0.025816 Aug 23 22:39:00.934329 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: [pid: 120856|app: 0|req: 790/1118] 10.222.0.88 () {58 vars in 1251 bytes} [Tue Aug 23 22:39:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-398648710 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 22:41:32.999191 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:41:32.999889 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Tue Aug 23 22:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 22:42:00.867125 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 22:42:00.867819 dv-cinder-850321-4-iscsi devstack@n-api.service[120856]: Tue Aug 23 22:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!